opensource/rocketmq
3
0
Fork 0
mirror of https://github.com/apache/rocketmq.git synced 2026-08-29 04:13:00 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,764 Commits 72 Branches 40 Tags
release-5.3.2
Commit Graph

355 Commits

Author SHA1 Message Date
lizhimins 2baaf044ea [maven-release-plugin] prepare release rocketmq-all-5.3.2 (#9231) 2025-03-08 14:07:17 +08:00
rongtong 19f799d936 [ISSUE #8340] RuntimeInfo and ClusterListSubCommand show ackThreadPoolQueueSize and ackThreadPoolQueueHeadWaitTimeMills (#8339) 
* RuntimeInfo and ClusterListSubCommand show ackThreadPoolQueueSize and ackThreadPoolQueueHeadWaitTimeMills

* RuntimeInfo and ClusterListSubCommand show ackThreadPoolQueueSize and ackThreadPoolQueueHeadWaitTimeMills
 2025-02-26 15:29:55 +08:00
ltamber 6148b8993a [ISSUE #9174] Add a collection of predefined Groups and common checking methods in the MixAll (#9175) 
Signed-off-by: ltamber <ltamber12@gmail.com>
 2025-02-12 15:38:42 +08:00
qianye 8086fc545d [ISSUE #9152] Broker getConsumeStats supports inputting multiple topics (#9153) 
* [ISSUE #9152] The getConsumeStats supports inputting multiple topics
 2025-02-05 14:41:53 +08:00
qianye b30afe8184 [ISSUE #9111] Support export broker RocksDB Config to json file (#9114) 
* [ISSUE #9111] Broker Support export RocksDB Config to json file and enhance admin tools
 2025-01-14 10:29:40 +08:00
lizhimins 35a6426ea9 [ISSUE #9025] [RIP-73] Pop Consumption Improvement Based on RocksDB (#9048) 2024-12-20 20:37:25 +08:00
rongtong bf2f2a7774 Fix incorrect path for exportMetadataInRocksDBCommand (#8941) 2024-11-18 17:25:20 +08:00
LetLetMe 0b24768500 [ISSUE #8822] Double write cq, reduce unnecessary switches (#8823) 
* Reduce unnecessary switches
 2024-10-29 19:09:35 +08:00
Zhanhui Li b86059c7c1 Support LMQ dispatch in case if Consume Queue Store is RocksDB-based (#8842) 
* feat: support LMQ dispatch

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: introduce group-commit for batch insertion of RocksDB KV pairs

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: propagate store error to broker module

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: fix all Bazel warning and errors

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* fix: remove unnecessary batch-ops when writing RocksDB using atomic flush

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: find a writable directory for RocksDB logs

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: clean up ConfigHelperTest

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: truncate consume queues in case commit log records are truncated

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: truncate LMQ max offsets

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: correct truncate boundary of consume queues

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: correct MessageExt encoding

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: remove unused import

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>
 2024-10-23 09:56:37 +08:00
rongtong 483a48a130 PrintMessageSubCommand support lmq (#8785) 2024-10-09 09:58:05 +08:00
lizhimins daf3d1a666 [maven-release-plugin] prepare for next development iteration (#8750) 2024-09-26 09:33:52 +08:00
lizhimins b122c8109d [maven-release-plugin] prepare release rocketmq-all-5.3.1 (#8749) 2024-09-25 23:24:56 +08:00
LetLetMe 3b5cbf86df [ISSUE #8698] Remove batch write in kv cq store and update rocksdb cq check tool (#8739) 2024-09-25 19:32:47 +08:00
yuz10 e2abbc31d9 [ISSUE #8740] fix rocksDBConfigToJson command (#8738) 
* fix rocksDBConfigToJson command

* fix
 2024-09-25 10:14:38 +08:00
LetLetMe 525f877f3b [ISSUE #8589] Support file format CQ and json format offset in-place upgrade to rocksdb management (#8600) 2024-09-23 19:24:15 +08:00
rongtong e5e38396ba [ISSUE #8591] Preliminary support for key commands of LMQ (#8590) 
* Preliminary support for key commands of LMQ

* Preliminary support for key commands of LMQ

* Optimize some code

* Fix some bugs and UTs for lmq support

* Fix UTs can not pass

* Fix UTs can not pass

* Add some check to prevent NPE
 2024-08-30 14:15:03 +08:00
caigy a1ea1eb1f2 [ISSUE #8576] Support Creating or Updating Subscription Groups in Batch 
support creating or updating groups in batch

support creating or updating groups in batch

support creating or updating groups in batch
 2024-08-27 15:21:53 +08:00
LetLetMe 2a938fb1bc [ISSUE #8058] Support for upgrading metadata in json to rocksdb (#8571) 2024-08-23 11:18:03 +08:00
lizhimins 5dc0c6a8b5 [maven-release-plugin] prepare for next development iteration (#8382) 2024-07-09 01:30:43 +08:00
lizhimins 7ee50ec32e [maven-release-plugin] prepare release rocketmq-all-5.3.0 (#8379) 2024-07-08 23:15:33 +08:00
hqbfz 3ecc73bcc4 [ISSUE #8278] Fix fail test (#8279) 
* fix fail test

* fix fail test
 2024-06-11 09:08:32 +08:00
guyinyou 4be8fd4372 [ISSUE #8265] Implement Batch Creation of Topics in RocketMQ Admin (#8267) 
* add UPDATE_AND_CREATE_TOPIC_LIST

* support creating or updating topic config in batch


---------

Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
Co-authored-by: gaoyang.cgy <gaoyang.cgy@alibaba-inc.com>
 2024-06-07 10:28:36 +08:00
dingshuangxi888 e1339ac8a0 [ISSUE #7560] [RIP-68] Support RocketMQ ACL 2.0 (#7725) 
[ISSUE #7560] [RIP-68] Support RocketMQ ACL 2.0 (#7725)
 2024-03-18 14:07:51 +08:00
rongtong f41160210a [maven-release-plugin] prepare for next development iteration (#7828) 2024-02-12 11:07:03 +08:00
rongtong 281a7b32f0 [maven-release-plugin] prepare release rocketmq-all-5.2.0 (#7827) 2024-02-11 17:53:50 +08:00
Zhouxiang Zhan b1d8d306a5 [ISSUE #7699] Add namespace v2 in client (#7700) 
* Add namespace v2

* Add NamespaceRpcHook

* Refector extends header

* Use Boolean in request header to remove unnecessary encode

* Add unit test

* Add NamespaceRpcHookTest

* Remove GrpcConverter#wrapResourceWithNamespace

* Optimize readability of RpcRequestHeader
 2024-01-12 10:46:15 +08:00
Zhouxiang Zhan 5b43387be3 [ISSUE #7543] Retry topic v2 in pop (#7544) 
* Implement pop retry topic v2

* Use pop retry topic v2 to notify the origin topic

* add parse group

* retry topic v2 compatibility

 * calculate consumer lag

 * delete retry topic
 2023-11-23 14:53:48 +08:00
Zhanhui Li 15d32db03b [ISSUE #7547] Let consumer be aware of message queue assignment change (#7548) 
* let consumer be aware of message queue assignment change

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* add unit test for DefaultMQPushConsumer#setMessageQueueListener

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: bazel build warnings

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

* fix: set MixCommitlogTest test size as medium

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

* allow cache bazel test results

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix code style issue by removing unused imports

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix #7552

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Signed-off-by: Zhanhui Li <lizhanhui@apache.org>
 2023-11-13 09:44:25 +08:00
rongtong 38d267672a Remove getBrokerClusterAclConfig from admin and server (#7486) 
* Remove getBrokerClusterAclConfig from admin and server

* Add @Deprecated annotation to GET_BROKER_CLUSTER_ACL_CONFIG request code
 2023-10-24 15:15:08 +08:00
fujian-zfj f565654351 [ISSUE #7064] [RIP-66-2] Support KV(RocksDB) Storage for ConsumeQueue (#7120) 
* typo int readme[ecosystem]

* consumequue support rocksdb

* fix rocksdb test

* fix rocksdb test

* remove unused method

* split into two tables

* CqUnit in Rocksdb [phyOffset, bodySize, tagHashCode, msgStoreTime]

* fix build.baze in tieredMessageStore

* skip RocksDBMessageStoreTest bazel

* skip RocksDBMessageStoreTest bazel

* Rocksdb TimerMessageStore

* fix unit test bazel

* fix store build.bazel

* fix store build.bazel

* optimize

* optimize

* polish

* build bytebuffer pair inner

* remove unused code

* DataConverter.CHARSET_UTF8

* fix comment

* fix comment

* rebuild test

* rebuild test

* optimize

* rebuild test

* polish

* polish

* rebuild test

* merge develop

* rebuild test

* rebuild test

* fix getConsumeQueue not find cq

* fix test

* rocksdb new version

* rebuild test

* fix bug

* Resolve conflicts after merging develop

* fix updateCqOffset

* fix recoverAbnormally

* fix recoverAbnormally

* polish

* polish

* polish

* remove exception in cleanunusedTopic

* remove exception in cleanunusedTopic

* remove exception in cleanunusedTopic

---------

Co-authored-by: RongtongJin <jinrongtong16@mails.ucas.ac.cn>
 2023-10-14 11:04:04 +08:00
石臻臻(Steven shi) c3b86cd1e3 [ISSUE #7398] Fix ExportConfigsCommand NPE (#7399) 
Co-authored-by: 石臻臻 <shirenchuang.src@cainiao.com>
 2023-09-26 16:07:13 +08:00
lk 73b3fde837 [maven-release-plugin] prepare for next development iteration (#7379) 2023-09-22 10:08:59 +08:00
lk 1a681bdf9b [maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377) 2023-09-21 19:58:29 +08:00
guyinyou c100d815d7 [ISSUE #7328] Convergent thread pool creation (#7329) 
* Convergence thread pool creation to facilitate subsequent iteration management

* Convergence thread pool creation in ThreadPoolMonitor.java

* fix unit test

* Convergence ThreadPool constructor

* Convergence ScheduledThreadPool constructor

* remove unused import

* Convergence ScheduledThreadPool constructor

* remove unused import

---------
 2023-09-11 10:13:56 +08:00
Ziyi Tan 3e100103af [ISSUE #7277] Enhance rocksDBConfigToJson to support metadata counting (#7276) 2023-08-29 13:48:51 +08:00
Ziyi Tan 5f6dc90f9d [ISSUE #7250] Beautify command rocksDBConfigToJson output 
Co-authored-by: Ziy1-Tan <ajb4596984460@gmail.com>
 2023-08-25 11:17:23 +08:00
Ziyi Tan 744167bd01 [ISSUE #7142] Add command RocksDBConfigToJson to inspect rocksdb content (#7180) 
* feat: add command `RocksDBConfigToJson` to inspect rocksdb content

Signed-off-by: Ziy1-Tan <ajb4596984460@gmail.com>

* refactor: fix style

---------

Signed-off-by: Ziy1-Tan <ajb4596984460@gmail.com>
Co-authored-by: Ziy1-Tan <ajb4596984460@gmail.com>
 2023-08-23 08:32:17 +08:00
yx9o fec1414814 [ISSUE #7166] Optimize the display format of admin (#7210) 2023-08-23 08:22:34 +08:00
yx9o a9c0b43f7f [ISSUE #7192] Correct typos (#7193) 2023-08-16 18:45:00 +08:00
yx9o ac411daa27 [ISSUE #7183] Correct mismatched commandDesc (#7184) 2023-08-15 08:31:00 +08:00
koado 1fe5d62334 [ISSUE #7074] Allow a BoundaryType to be specified when retrieving offset based on the timestamp (#7082) 
* add new interface for searching offset with boundary type

* format code

* fix failed test

* unify two BoundaryType class

* add interface getOffsetInQueueByTime(long timestamp, BoundaryType boundaryTYpe) in ConsumeQueueInterface

* fix AdminBrokerProcessorTest unnecessary Mockito stubbings
 2023-08-03 11:40:16 +08:00
rongtong e369d7deac [maven-release-plugin] prepare for next development iteration (#6939) 2023-06-24 14:31:42 +08:00
rongtong f7425f52f9 [maven-release-plugin] prepare release rocketmq-all-5.1.3 (#6938) 2023-06-24 12:23:11 +08:00
Zhouxiang Zhan aaa4a4b5fc Add attribute for SubscriptionGroupConfig (#6891) 2023-06-14 11:46:46 +08:00
rongtong ad4cc957fb [maven-release-plugin] prepare for next development iteration (#6895) 2023-06-12 19:12:25 +08:00
rongtong 749967baa8 [maven-release-plugin] prepare release rocketmq-all-5.1.2 (#6892) 2023-06-12 17:44:39 +08:00
Drizzle bee5077bcb [ISSUE #6336] [RIP-62] Cold Read Control (#6507) 2023-06-05 17:09:31 +08:00
rongtong 8aea26ef8f [maven-release-plugin] prepare for next development iteration 2023-05-15 19:48:34 +08:00
rongtong e244ebb99a [maven-release-plugin] prepare release rocketmq-all-5.1.1 (#6763) 2023-05-15 18:51:01 +08:00
rongtong e3b8178871 [ISSUE #6570] Fix the issue that expectLogicOffset is greater than currentLogicOffset in consumeQueue build when the message is illegal (#6641) 
* Fix the issue that expectLogicOffset is greater than currentLogicOffset in consumeQueue build when the message is illegal

* Add new UT

* Fix bug that UT can not pass

* Polish the variable name

* Polish the comment

* Add more comments
 2023-04-26 11:24:47 +08:00