Commit Graph

8141 Commits

Author SHA1 Message Date
rongtong f7425f52f9 [maven-release-plugin] prepare release rocketmq-all-5.1.3 (#6938) rocketmq-all-5.1.3 2023-06-24 12:23:11 +08:00
rongtong 3358592232 [ISSUE #6935] Prepare to release Apache RocketMQ 5.1.3 2023-06-23 15:42:01 +08:00
yuz10 867c296150 [ISSUE #6916] support startsWith and endsWith in sql filter. (#6915)
* support startsWith and endsWith in sql filter.

* add tests

* add tests
2023-06-23 15:41:16 +08:00
lizhimins 9899be15e7 [ISSUE #6933] Support recreate file if local cq and tiered storage offset not match 2023-06-23 15:37:57 +08:00
Guocheng Tang 5d6ee6384f [ISSUE #6910] Extract the interval of fetchNameServerAddr
Co-authored-by: RongtongJin <jinrongtong16@mails.ucas.ac.cn>
2023-06-23 14:21:29 +08:00
yuz10 fd4a397a14 [ISSUE #6917] fix cannot query all messages of the same msgId
Co-authored-by: y00421926 <yuzhou4@huawei.com>
2023-06-23 11:31:40 +08:00
rongtong f76e8670b0 [ISSUE #6931] Set table reference the same object for setSubscriptionGroupTable method 2023-06-23 11:31:16 +08:00
rongtong 82492a6208 [ISSUE #6926] Fixing the error in the initialization order of replicasManager caused the controller mode to fail to start. 2023-06-23 10:56:18 +08:00
yuz10 4e09a9cfe9 [ISSUE #6904] Fix fail to start broker if mapped file size is 0 (#6903) 2023-06-22 23:43:59 +08:00
rongtong 1f0cdc88f8 Temporarily ignoring testQueryMessageAsync testing on the Linux platform (#6930) 2023-06-22 19:26:07 +08:00
Quan 6238caaac9 [ISSUE #6841] new feature: pop batch ack implementation broker-side (#6842) 2023-06-19 11:06:50 +08:00
Quan 3ac885705d new feature: sql expression CONTAINS support (#6864) 2023-06-16 16:22:46 +08:00
gaoyf 0b76f6f619 Fix the problem that the proxy in the cluster mode obtains the wrong address of broker (#6909)
Fix the problem that the proxy in the cluster mode obtains the wrong address of the broker.
2023-06-16 10:15:06 +08:00
Zhouxiang Zhan 2246c32537 Add attributesBuilderSupplier for BrokerMetricsManager (#6901)
* Add attributesBuilderSupplier for BrokerMetricsManager

* fix

* add initial value
2023-06-15 16:33:11 +08:00
城南少年与猫 aea5811df0 [ISSUE #6884] Resolve proxy sending mentality to broker and unable to find ACL configuration related (#6885)
Co-authored-by: fengbaichao <fbc@163.com>
2023-06-15 10:00:45 +08:00
Drizzle 3dda55e812 [RIP-64] Heartbeat Optimization (#6724) 2023-06-14 15:00:24 +08:00
Zhouxiang Zhan aaa4a4b5fc Add attribute for SubscriptionGroupConfig (#6891) 2023-06-14 11:46:46 +08:00
imzs 4291971c03 [ISSUE #5866] fix client-side memory leak of inactive channel (#5867)
* fix #5866 Client-side memory leak of inactive channel

* also accept RemotingSendRequestException when NettyRemotingAbstract#failFast invoked.

---------

Co-authored-by: moling <zhangshuo.zs@alibaba-inc.com>
2023-06-13 16:47:10 +08:00
cnScarb b44a1ebc36 [ISSUE apache#6576] Fix pop lmq message in client (#6577) 2023-06-13 16:29:05 +08:00
rongtong ad4cc957fb [maven-release-plugin] prepare for next development iteration (#6895) 2023-06-12 19:12:25 +08:00
rongtong 749967baa8 [maven-release-plugin] prepare release rocketmq-all-5.1.2 (#6892) rocketmq-all-5.1.2 2023-06-12 17:44:39 +08:00
Vincent Lee 91d8ee16a0 [ISSUE #6800] Change the config variable isEnableBatchPush to enableBatchPush (#6801)
* fix: wrong setter for config isEnableBatchPush

Change-Id: I1ebf4748c26c42efb058c11a8b5084b69213892c

* fix: change isEnableBatchPush to enableBatchPush

Change-Id: I13db49a30841fe5ff9a548f02afa0cc272ba027d
2023-06-12 13:59:11 +08:00
gaoyf 0f1ff25512 [ISSUE #6881] Fix scheduled messages are replayed bug (#6882)
* fix scheduled messages are replayed bug

* scheduledPersistService reset to final and constructed in the constructor
2023-06-11 10:31:30 +08:00
lizhimins 6eac107005 [ISSUE #6633] [RIP-65] Improving Tiered Storage Implementation (#6781)
[ISSUE #6633] [RIP-65] Improving Tiered Storage Implementation
2023-06-09 21:07:53 +08:00
deepsola 6c9359fbfc [ISSUE #6824] Add golang e2e test (#6825)
* Update push-ci.yml, add golang test

* Update pr-e2e-test.yml, add golang test
2023-06-09 14:35:49 +08:00
Shuangxi Ding 4d82b307ef [ISSUE #6866] Move the judgment logic of grpc TLS mode to improve the scalability of ProtocolNegotiator (#6867)
[ISSUE #6866] Move the judgment logic of grpc TLS mode to improve the scalability of ProtocolNegotiator

---------

Co-authored-by: 徒钟 <shuangxi.dsx@alibaba-inc.com>
2023-06-08 11:46:03 +08:00
rongtong f10f90550f Modify CURRENT_VERSION to 5.1.2 (#6862) 2023-06-07 15:11:03 +08:00
TheR1sing3un 450d0d69cc [ISSUE #6154] Support Amazon S3 backend in TieredStorage (#6495)
* support s3 backend in tiered storage

* refactor(tieredstorage): Unify all object storage configuration properties

1. Unify all object storage configuration properties

* refactor(tieredstorage): replace some lambda function with more simple expression

1. replace some lambda function with more simple expression

* style(tieredstorage): perfect comments on ChunkMetadata

1. perfect comments on ChunkMetadata

* refactor(tieredstorage): perfect lambda expression

1. perfect lambda expression

* fix(tieredstorage): fix unmatched config attributes in brokerS3.conf

1. fix unmatched config attributes in brokerS3.conf

* feat(tieredstorage): More context in logging output

1. More context in logging output

* fix(tieredstorage): fix wrong concurrently put

1. fix wrong concurrently put

* test(tieredstorage): add UT to verify TieredFileSegmentInputStream

1. add UT to verify TieredFileSegmentInputStream

* refactor(tieredstorage): better code placement

1. better code placement

* refactor(tieredstorage): refactor TieredFileSegmentInputStream for better understandability

1. refactor TieredFileSegmentInputStream for better understandability

* feat(tieredstorage): support `reset` of TieredFileSegmentInputStream

1. support `reset` of TieredFileSegmentInputStream

* fix(tieredstorage): fix wrong position when failed in `S3FileSegment#commit0`

1. fix wrong position when failed in `S3FileSegment#commit0`

* fix(tieredstorage): fix still have upload buffer when already seal the segment

1. fix still have upload buffer when already seal the segment

* test(tieredstorage): fix wrong assertion

1. fix wrong assertion

* feat(tieredstorage): support switch to enable merge chunks into segment

1. support switch to enable merge chunks into segment

* feat(tieredstorage): add more debug log in TieredMessageStore

1. add more debug log in TieredMessageStore

* style(tieredstorage): use rmq code style

1. use rmq code style

* feat(tieredstorage): add metrics for S3 provider

1. add metrics for S3 provider

* fix(tieredstorage): resolve conflicts after rebasing master

1. resolve conflicts after rebasing master

Closes https://github.com/apache/rocketmq/issues/6624

* style(tieredstorage): change log level

1. change log level

Closes https://github.com/apache/rocketmq/issues/6154

* build(controller): build tieredstorage with bazel

1. build tieredstorage with bazel

* build(controller): build tieredstorage with bazel

1. build tieredstorage with bazel

* style(tieredstorage): change log level

1. change log level

Closes https://github.com/apache/rocketmq/issues/6154

* test(tieredstorage): ignore tests about S3Mock

1. ignore tests about S3Mock

* test(tieredstorage): ignore tests about S3Mock

1. ignore tests about S3Mock
2023-06-07 13:07:51 +08:00
lk a325d144b2 [ISSUE #6858] passing through ProxyContext for future expansion (#6859) 2023-06-06 17:07:06 +08:00
Drizzle bee5077bcb [ISSUE #6336] [RIP-62] Cold Read Control (#6507) 2023-06-05 17:09:31 +08:00
cnScarb 1d62b74ab6 [ISSUE #6779] Support scheduled message for LMQ (#6780) 2023-06-02 10:36:09 +08:00
Ji Juntao acd8b099df [ISSUE #6849] Fix the issue of increasing RT in three replicators 2023-06-02 09:57:46 +08:00
rongtong fb1c67d536 Fix incorrect naming (#6843) 2023-06-01 16:38:29 +08:00
TheR1sing3un c68fb8f1b9 [ISSUE #6845] Build controller with bazel (#6846) 2023-06-01 13:42:52 +08:00
TheR1sing3un 1a9a8b1969 [ISSUE #6624]Support mark() & reset() for TieredFileSegmentInputStream (#6625)
* test(tieredstorage): add UT to verify TieredFileSegmentInputStream

1. add UT to verify TieredFileSegmentInputStream

* refactor(tieredstorage): refactor TieredFileSegmentInputStream

1. refactor TieredFileSegmentInputStream

* feat(tieredstorage): support mark&reset TieredFileSegmentInputStream

1. support mark&reset TieredFileSegmentInputStream

* style(tieredstorage): remove commended code in TieredFileSegmentInputStreamTest

1. remove commended code in TieredFileSegmentInputStreamTest

* refactor(tieredstorage): better code placement

1. better code placement

* refactor(tieredstorage): refactor TieredFileSegmentInputStream for better understandability

1. refactor TieredFileSegmentInputStream for better understandability

* refactor(tieredstorage): refactor some code in TieredFileSegmentInputStream

1. refactor some code in TieredFileSegmentInputStream

* refactor(tieredstorage): refactor TieredFileSegmentInputStream

1. refactor TieredFileSegmentInputStream
2. add a
TieredFileSegmentInputStream.Factory to build instance

* refactor(tieredstorage): refactor TieredFileSegmentInputStream related directory structure

1. refactor TieredFileSegmentInputStream related directory structure

* refactor(tieredstorage): delete `commitLogOffsetBuffer` in TieredCommitLogInputStream

1. delete `commitLogOffsetBuffer` in TieredCommitLogInputStream

* perf(tieredstorage): benchmark TieredFileSegmentInputStream pef

1. benchmark TieredFileSegmentInputStream pef

Closes https://github.com/apache/rocketmq/issues/6624

* feat(tieredstorage): optimized `read(byte[], int, int)` for TieredFIleSegmentInputStream

1. optimized `read(byte[], int, int)` for TieredFIleSegmentInputStream

Closes https://github.com/apache/rocketmq/issues/6624

* fix(tieredstorage): fix a dead cycle in TieredFileSegmentInputStream

1. fix a dead cycle in TieredFileSegmentInputStream.java
2. remove unused JMH
related dependency

Closes https://github.com/apache/rocketmq/issues/6624
2023-05-31 14:58:46 +08:00
TheR1sing3un 529976f8fb [ISSUE #6777] Support metric in controller (#6778)
* feat(controller): build metrics framework in controller module

1. build metrics framework in controller module

* feat(controller): record metrics about controller

1. record metrics about controller

* fix(controller): fix after review

1. fix after review

Closes https://github.com/apache/rocketmq/issues/6777

* fix(controller): fix after review

1. fix lack of dependency

Closes https://github.com/apache/rocketmq/issues/6777
2023-05-30 14:17:59 +08:00
lk 40ada807b3 [ISSUE #6828] return the number of assignments equal to the number of messageQueues for order consumer (#6829) 2023-05-30 14:01:25 +08:00
@xiaochangbai f4439c971c [ISSUE #6819] Rename brokerHeartbeatExecutorService executorService name (#6820) 2023-05-28 20:05:03 +08:00
DL1231 e545e3b359 [ISSUE #6803] Benchmark support reportInterval option (#6804) 2023-05-27 10:38:17 +08:00
rongtong ea3298065c Polish the persistent_unique_broker_id document (#6817) 2023-05-26 21:51:24 +08:00
hiyo 330d56b2cf [ISSUE#6595] Fix NPE and repeat access key log (#6596)
* [ISSUE#6595] fix NPE and repeat access key log

* optimize code
2023-05-26 08:38:59 +08:00
maclong1989 224d660670 doc: fix typo in operation.md (#6799)
Signed-off-by: jiangyl3 <jiangyl3@asiainfo.com>
Co-authored-by: jiangyl3 <jiangyl3@asiainfo.com>
2023-05-25 17:51:46 +08:00
Dongyuan Pan 985319ba2a [ISSUE #6797]Support batch ack when reput buffer ak to store in PopBufferMergeService (#6798)
* add back for PopReviveService

* add batch ack for PopReviveService
2023-05-24 11:22:18 +08:00
lk eef581b464 [ISSUE #6785] Isolate the remoteChannel by group (#6786) 2023-05-23 16:41:46 +08:00
DL1231 3dcba4b5cd [ISSUE #6792] Fix the bug that send method blocked on log.warn for a long time (#6793) 2023-05-23 11:36:44 +08:00
DL1231 016b0310e0 [ISSUE #6789] Modify placeholder in DefaultMQProducerImpl (#6790) 2023-05-23 10:49:25 +08:00
mxsm bd7db7ec62 [ISSUE #6774] Update README.md rocketmq version to 5.1.1 (#6775) 2023-05-21 15:45:12 +08:00
mxsm 7c24daf205 [ISSUE #6771] Merge some cases in PullMessageProcessor#composeResponseHeader method (#6772) 2023-05-21 11:15:55 +08:00
haiyanghan 70480a1fa9 Remove redundant variables (#6740) 2023-05-17 17:25:59 +08:00
Lobo Xu 92ea901d7b [ISSUE #6765] org.apache.rocketmq.util.cache doesn't look like it's being used
Co-authored-by: loboxu <loboxu@tencent.com>
2023-05-16 13:36:11 +08:00