Commit Graph

344 Commits

Author SHA1 Message Date
lizhimins 2baaf044ea [maven-release-plugin] prepare release rocketmq-all-5.3.2 (#9231) 2025-03-08 14:07:17 +08:00
imzs 19393e0475 [ISSUE #8974] Add feature switch of recalling, disable by default (#9067) 2024-12-27 13:56:09 +08:00
imzs bfb3d17ef1 [ISSUE #8974] Support recalling of delay message (#8975) 2024-12-09 16:56:12 +08:00
Zhanhui Li b86059c7c1 Support LMQ dispatch in case if Consume Queue Store is RocksDB-based (#8842)
* feat: support LMQ dispatch

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: introduce group-commit for batch insertion of RocksDB KV pairs

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: propagate store error to broker module

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: fix all Bazel warning and errors

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* fix: remove unnecessary batch-ops when writing RocksDB using atomic flush

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: find a writable directory for RocksDB logs

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: clean up ConfigHelperTest

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: truncate consume queues in case commit log records are truncated

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: truncate LMQ max offsets

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: correct truncate boundary of consume queues

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: correct MessageExt encoding

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: remove unused import

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>
2024-10-23 09:56:37 +08:00
mawen12 c033c3e85f [ISSUE #8848] Fix log typo 2024-10-23 08:29:35 +08:00
rongtong 4f5f705f16 [ISSUE #8780] Implement asynchronous storage of ack/ck messages in pop consume to enhance performance (#8727)
* Pop consume asynchronization

* Pass UTs and ITs

* Pass the checkstyle

* Fix LocalGrpcIT can not pass

* Fix the UT can not pass

* Simplify duplicate methods in EscapeBridge
2024-10-16 13:39:27 +08:00
luozongle01 c826373598 [ISSUE #8798] Fix typo (#8799) 2024-10-10 09:52:45 +08:00
lizhimins daf3d1a666 [maven-release-plugin] prepare for next development iteration (#8750) 2024-09-26 09:33:52 +08:00
lizhimins b122c8109d [maven-release-plugin] prepare release rocketmq-all-5.3.1 (#8749) 2024-09-25 23:24:56 +08:00
rongtong cab4fdaec1 [ISSUE #8718] Fix flaky CreateAndUpdateTopicIT (#8717) 2024-09-20 13:53:37 +08:00
kissrain 6024db77f5 Fix typo in BaseConf (#8679)
Co-authored-by: 赤远 <jingyang.cjy@antfin.com>
2024-09-19 17:28:53 +08:00
小陈 e7eda2c957 [ISSUE #8668] Improve CI pipeline reliability with better log viewing and test fixes (#8667)
* Add sleep 3s after consumer shutdown to ensure queue rebanlance

* Add a step to upload test report

* Unified code style

* Unified mockito runner configuration to suppress UnnecessaryStubbingException
2024-09-09 16:32:19 +08:00
小陈 3368c06e6b [ISSUE #8643] Add an integration testing pipeline to current CI workflow (#8644)
* Add a it pipeline to workflows

* Trigger

* Rename it job

* Remove branch trigger

* Remove the step of uploading report
2024-09-05 10:13:02 +08:00
lizhimins 5dc0c6a8b5 [maven-release-plugin] prepare for next development iteration (#8382) 2024-07-09 01:30:43 +08:00
lizhimins 7ee50ec32e [maven-release-plugin] prepare release rocketmq-all-5.3.0 (#8379) 2024-07-08 23:15:33 +08:00
hqbfz 6b59155661 [ISSUE #7941] add override annotation (#7959)
* increase missing annotation

* Revert "increase missing annotation"

This reverts commit c1f3cef51d.

* increase missing annotation
2024-06-13 10:28:02 +08:00
cnScarb a15088cbd3 [ISSUE #8096] fix log placeholder 2024-05-07 09:49:43 +08:00
Zhouxiang Zhan c727f3a069 Fix notification integration test in pop consume mode (#7947) 2024-03-20 11:05:02 +08:00
dingshuangxi888 e1339ac8a0 [ISSUE #7560] [RIP-68] Support RocketMQ ACL 2.0 (#7725)
[ISSUE #7560] [RIP-68] Support RocketMQ ACL 2.0 (#7725)
2024-03-18 14:07:51 +08:00
rongtong f41160210a [maven-release-plugin] prepare for next development iteration (#7828) 2024-02-12 11:07:03 +08:00
rongtong 281a7b32f0 [maven-release-plugin] prepare release rocketmq-all-5.2.0 (#7827) 2024-02-11 17:53:50 +08:00
bazelisky af1936d93a [ISSUE #7715] Update Bazel toolchain to make the CI work (#7714)
* Update bazel toolchain

Signed-off-by: Bazelisky <bazelisk@hotmail.com>

* fix a bad test case as it violates requirement of ConcurrentHashMap#computeIfAbsent

Signed-off-by: Bazelisky <bazelisk@hotmail.com>

* Exclude flaky tests from test suite

Signed-off-by: bazelisky <155456828+bazelisky@users.noreply.github.com>

* fix: format issue

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* fix: Remove unused import

* fix deps issue

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* Expose data property of java_test, allowing to specify run_file

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

---------

Signed-off-by: Bazelisky <bazelisk@hotmail.com>
Signed-off-by: bazelisky <155456828+bazelisky@users.noreply.github.com>
Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>
Co-authored-by: Zhanhui Li <lizhanhui@gmail.com>
2024-02-01 16:52:55 +08:00
landonchan90 06e22b4b42 [ISSUE #7765] Fix unit test testEstimateLag
Co-authored-by: landonchan90 <landaonChan@163.com>
2024-01-31 17:39:30 +08:00
Zhouxiang Zhan 8a36471a19 [ISSUE #7543] Add enableRetryTopicV2 brokerConfig (#7734)
* Add enableRetryTopicV2
2024-01-11 11:11:53 +08:00
zhanghong ca721b0145 [ISSUE #7462] Remove deprecated LocalTransactionExecuter (#7463) 2023-11-21 14:03:24 +08:00
Zhanhui Li 15d32db03b [ISSUE #7547] Let consumer be aware of message queue assignment change (#7548)
* let consumer be aware of message queue assignment change

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* add unit test for DefaultMQPushConsumer#setMessageQueueListener

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: bazel build warnings

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

* fix: set MixCommitlogTest test size as medium

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

* allow cache bazel test results

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix code style issue by removing unused imports

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix #7552

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Signed-off-by: Zhanhui Li <lizhanhui@apache.org>
2023-11-13 09:44:25 +08:00
lk 00965d8c11 [ISSUE #7531] Clear POP_CK when sending messages (#7532) 2023-11-06 09:46:39 +08:00
lk 73b3fde837 [maven-release-plugin] prepare for next development iteration (#7379) 2023-09-22 10:08:59 +08:00
lk 1a681bdf9b [maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377) 2023-09-21 19:58:29 +08:00
Jixiang Jin dddd58d2cc Set experimental_ui_max_stdouterr_bytes to 10MB in bazel (#7348)
* Set experimental_ui_max_stdouterr_bytes to 10MB and Fix IT
2023-09-12 19:17:36 +08:00
Ziyi Tan 0dbd0772b9 [ISSUE #7326] Split the request to register to the nameserver (#7325)
Signed-off-by: Ziy1-Tan <ajb459684460@gmail.com>
2023-09-11 15:48:07 +08:00
guyinyou c100d815d7 [ISSUE #7328] Convergent thread pool creation (#7329)
* Convergence thread pool creation to facilitate subsequent iteration management

* Convergence thread pool creation in ThreadPoolMonitor.java

* fix unit test

* Convergence ThreadPool constructor

* Convergence ScheduledThreadPool constructor

* remove unused import

* Convergence ScheduledThreadPool constructor

* remove unused import

---------
2023-09-11 10:13:56 +08:00
lk 72d796f2b2 [ISSUE #7205] support batch ack for pop orderly (#7206) 2023-08-18 11:55:39 +08:00
fujian-zfj 3a6ef0400c [ISSUE #7064] [RIP-66-1] Support KV(RocksDB) Storage for Metadata (#7092)
* typo int readme[ecosystem]

* rocksdb metadata

* add unit test

* fix testOffsetPersistInMemory

* fix unit test

* fix unit test

* remove unused import

* move RocksDBOffsetSerialize to broker moudle

* Fix bazel build scripts

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Flag QueryMsgByKeyIT as flaky as it fails at frequency: 5 out of 32

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* change public to private of some inner method

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2023-08-05 00:32:11 +08:00
rongtong 047ef7498f Ensuring consistency between broker and nameserver data when deleting a topic (#7066)
Co-authored-by: 尘央 <xinyuzhou.zxy@alibaba-inc.com>
2023-07-25 14:00:22 +08:00
rongtong e369d7deac [maven-release-plugin] prepare for next development iteration (#6939) 2023-06-24 14:31:42 +08:00
rongtong f7425f52f9 [maven-release-plugin] prepare release rocketmq-all-5.1.3 (#6938) 2023-06-24 12:23:11 +08:00
rongtong ad4cc957fb [maven-release-plugin] prepare for next development iteration (#6895) 2023-06-12 19:12:25 +08:00
rongtong 749967baa8 [maven-release-plugin] prepare release rocketmq-all-5.1.2 (#6892) 2023-06-12 17:44:39 +08:00
lk 40ada807b3 [ISSUE #6828] return the number of assignments equal to the number of messageQueues for order consumer (#6829) 2023-05-30 14:01:25 +08:00
lk 9dfd4a9599 [ISSUE #6761] Support reentrant notification orderly for broker (#6762) 2023-05-16 11:32:11 +08:00
rongtong 8aea26ef8f [maven-release-plugin] prepare for next development iteration 2023-05-15 19:48:34 +08:00
rongtong e244ebb99a [maven-release-plugin] prepare release rocketmq-all-5.1.1 (#6763) 2023-05-15 18:51:01 +08:00
Zhouxiang Zhan 0a329ba627 [ISSUE #6699] Make NotificationProcessor use PopLongPollingService (#6700)
* Refector PopLongPollingService

* Use enum PollingResult to replace int value
* Move PopLongPollingService to upper level
* Move wakeUp and polling method into PopLongPollingService

* NotificationProcessor use PopLongPollingService

* Add BORN_TIME check

* add NotificationIT
2023-05-08 11:49:02 +08:00
lk 57642bc630 [ISSUE #6691] Support reentrant pop orderly for broker (#6692) 2023-05-05 15:06:11 +08:00
Robin Han b3868ab606 (fix): logback config path seperator and brokerLogDir default value m… (#6590)
* (fix): logback config path seperator and brokerLogDir default value missing

* (fix): replace / with file.seperator in proxy test logback config

---------

Co-authored-by: Robin Han <robin@Robindendiannao.lan>
2023-04-18 16:48:34 +08:00
hiyo 0faa0a2c7d [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromName… (#6452)
* [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromNameServer parameters

* Fix to make Bazel CI pass

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Fix typo

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2023-03-23 20:30:21 +08:00
TheR1sing3un 19eafc80ff fix(broker): fix wrong test
1. fix wrong test
2023-03-14 09:40:15 +08:00
RongtongJin bbf54f8a71 Modify StorePathMetadata to StorePathBrokerIdentity 2023-03-14 09:40:15 +08:00
RongtongJin 3a141868b7 Fix some typos and log output 2023-03-14 09:40:15 +08:00