Commit Graph
327 Commits
Author SHA1 Message Date
rongtong 38d267672a Remove getBrokerClusterAclConfig from admin and server (#7486)
* Remove getBrokerClusterAclConfig from admin and server

* Add @Deprecated annotation to GET_BROKER_CLUSTER_ACL_CONFIG request code
2023-10-24 15:15:08 +08:00
fujian-zfjandRongtongJin f565654351 [ISSUE #7064] [RIP-66-2] Support KV(RocksDB) Storage for ConsumeQueue (#7120)
* typo int readme[ecosystem]

* consumequue support rocksdb

* fix rocksdb test

* fix rocksdb test

* remove unused method

* split into two tables

* CqUnit in Rocksdb [phyOffset, bodySize, tagHashCode, msgStoreTime]

* fix build.baze in tieredMessageStore

* skip RocksDBMessageStoreTest bazel

* skip RocksDBMessageStoreTest bazel

* Rocksdb TimerMessageStore

* fix unit test bazel

* fix store build.bazel

* fix store build.bazel

* optimize

* optimize

* polish

* build bytebuffer pair inner

* remove unused code

* DataConverter.CHARSET_UTF8

* fix comment

* fix comment

* rebuild test

* rebuild test

* optimize

* rebuild test

* polish

* polish

* rebuild test

* merge develop

* rebuild test

* rebuild test

* fix getConsumeQueue not find cq

* fix test

* rocksdb new version

* rebuild test

* fix bug

* Resolve conflicts after merging develop

* fix updateCqOffset

* fix recoverAbnormally

* fix recoverAbnormally

* polish

* polish

* polish

* remove exception in cleanunusedTopic

* remove exception in cleanunusedTopic

* remove exception in cleanunusedTopic

---------

Co-authored-by: RongtongJin <jinrongtong16@mails.ucas.ac.cn>
2023-10-14 11:04:04 +08:00
石臻臻(Steven shi)and石臻臻 c3b86cd1e3 [ISSUE #7398] Fix ExportConfigsCommand NPE (#7399)
Co-authored-by: 石臻臻 <shirenchuang.src@cainiao.com>
2023-09-26 16:07:13 +08:00
lk 73b3fde837 [maven-release-plugin] prepare for next development iteration (#7379) 2023-09-22 10:08:59 +08:00
lk 1a681bdf9b [maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377) 2023-09-21 19:58:29 +08:00
guyinyou c100d815d7 [ISSUE #7328] Convergent thread pool creation (#7329)
* Convergence thread pool creation to facilitate subsequent iteration management

* Convergence thread pool creation in ThreadPoolMonitor.java

* fix unit test

* Convergence ThreadPool constructor

* Convergence ScheduledThreadPool constructor

* remove unused import

* Convergence ScheduledThreadPool constructor

* remove unused import

---------
2023-09-11 10:13:56 +08:00
Ziyi Tan 3e100103af [ISSUE #7277] Enhance rocksDBConfigToJson to support metadata counting (#7276) 2023-08-29 13:48:51 +08:00
Ziyi TanandZiy1-Tan 5f6dc90f9d [ISSUE #7250] Beautify command rocksDBConfigToJson output
Co-authored-by: Ziy1-Tan <ajb4596984460@gmail.com>
2023-08-25 11:17:23 +08:00
Ziyi TanandZiy1-Tan 744167bd01 [ISSUE #7142] Add command RocksDBConfigToJson to inspect rocksdb content (#7180)
* feat: add command `RocksDBConfigToJson` to inspect rocksdb content

Signed-off-by: Ziy1-Tan <ajb4596984460@gmail.com>

* refactor: fix style

---------

Signed-off-by: Ziy1-Tan <ajb4596984460@gmail.com>
Co-authored-by: Ziy1-Tan <ajb4596984460@gmail.com>
2023-08-23 08:32:17 +08:00
yx9o fec1414814 [ISSUE #7166] Optimize the display format of admin (#7210) 2023-08-23 08:22:34 +08:00
yx9o a9c0b43f7f [ISSUE #7192] Correct typos (#7193) 2023-08-16 18:45:00 +08:00
yx9o ac411daa27 [ISSUE #7183] Correct mismatched commandDesc (#7184) 2023-08-15 08:31:00 +08:00
koado 1fe5d62334 [ISSUE #7074] Allow a BoundaryType to be specified when retrieving offset based on the timestamp (#7082)
* add new interface for searching offset with boundary type

* format code

* fix failed test

* unify two BoundaryType class

* add interface getOffsetInQueueByTime(long timestamp, BoundaryType boundaryTYpe) in ConsumeQueueInterface

* fix AdminBrokerProcessorTest unnecessary Mockito stubbings
2023-08-03 11:40:16 +08:00
rongtong e369d7deac [maven-release-plugin] prepare for next development iteration (#6939) 2023-06-24 14:31:42 +08:00
rongtong f7425f52f9 [maven-release-plugin] prepare release rocketmq-all-5.1.3 (#6938) 2023-06-24 12:23:11 +08:00
Zhouxiang Zhan aaa4a4b5fc Add attribute for SubscriptionGroupConfig (#6891) 2023-06-14 11:46:46 +08:00
rongtong ad4cc957fb [maven-release-plugin] prepare for next development iteration (#6895) 2023-06-12 19:12:25 +08:00
rongtong 749967baa8 [maven-release-plugin] prepare release rocketmq-all-5.1.2 (#6892) 2023-06-12 17:44:39 +08:00
Drizzle bee5077bcb [ISSUE #6336] [RIP-62] Cold Read Control (#6507) 2023-06-05 17:09:31 +08:00
rongtong 8aea26ef8f [maven-release-plugin] prepare for next development iteration 2023-05-15 19:48:34 +08:00
rongtong e244ebb99a [maven-release-plugin] prepare release rocketmq-all-5.1.1 (#6763) 2023-05-15 18:51:01 +08:00
rongtong e3b8178871 [ISSUE #6570] Fix the issue that expectLogicOffset is greater than currentLogicOffset in consumeQueue build when the message is illegal (#6641)
* Fix the issue that expectLogicOffset is greater than currentLogicOffset in consumeQueue build when the message is illegal

* Add new UT

* Fix bug that UT can not pass

* Polish the variable name

* Polish the comment

* Add more comments
2023-04-26 11:24:47 +08:00
Robin HanandRobin Han b3868ab606 (fix): logback config path seperator and brokerLogDir default value m… (#6590)
* (fix): logback config path seperator and brokerLogDir default value missing

* (fix): replace / with file.seperator in proxy test logback config

---------

Co-authored-by: Robin Han <robin@Robindendiannao.lan>
2023-04-18 16:48:34 +08:00
fuyou001andRongtongJin 17aa86c618 [ISSUE #6324] Improving compact topic stability (#6353)
Co-authored-by: RongtongJin <jinrongtong16@mails.ucas.ac.cn>
2023-03-28 10:41:23 +08:00
hardyfish 94db42ade7 [ISSUE #6292] fix typos (#6293)
* fix typos

* fix typos

* fix typos
2023-03-15 15:41:01 +08:00
RongtongJin a240753951 Fix CleanControllerBrokerMetaSubCommand and ReElectMasterSubCommand parameter error 2023-03-14 09:40:15 +08:00
TheR1sing3un c94c65b691 fix(admin): fix incompatible command: CleanBrokerMeta
1. fix incompatible command: CleanBrokerMeta
2023-03-14 09:40:15 +08:00
RongtongJin c8bc4e84a0 Rename cleanBrokerData subCommand to cleanBrokerMetadata 2023-03-14 09:40:15 +08:00
RongtongJin 28618e95ab Polish the code structure and code style 2023-03-14 09:40:15 +08:00
RongtongJin bbf54f8a71 Modify StorePathMetadata to StorePathBrokerIdentity 2023-03-14 09:40:15 +08:00
TheR1sing3un 2515ea5f98 fix(admin): print masterBrokerId when calling GetSyncStateSet
1. print masterBrokerId when calling GetSyncStateSet
2023-03-14 09:40:15 +08:00
TheR1sing3un 03d6ba23e4 style(controller): remove unused import
1. remove unused import
2023-03-14 09:40:15 +08:00
TheR1sing3un f843851788 fix(controller): fix some bug to pass AutoSwitchRoleIntegrationTest
1. fix some bug to pass AutoSwitchRoleIntegrationTest
2023-03-14 09:40:15 +08:00
TheR1sing3un 11b2cb84a6 feat(broker): fix some bugs to successfully compile project
1. fix some bugs to successfully compile project
2023-03-14 09:40:15 +08:00
TheR1sing3un a1de567e11 [ISSUE#5045] Refactor the register and elect-master process in controller mode (#5046)
* refactor(controller): refactor the register logic

1. refactor the register logic

* refactor(controller): remove unused field in ElectMasterEvent

1. remove unused field in ElectMasterEvent

* feat(controller): add a tryElectMaster request and process logic about it

1. add a tryElectMaster request and process logic about it

* feat(controller): refactor ReplicasInfoManagerTest

1. refactor ReplicasInfoManagerTest

* refactor(controller): refactor DLedgerControllerTest

1. refactor DLedgerControllerTest

* refactor(controller): refactor ControllerManagerTest

1. refactor ControllerManagerTest

* refactor(controller): refactor ReplicasInfoManagerTest

1. refactor ReplicasInfoManagerTest

* refactor(controller): refactor register process and pass the junit test

1. refactor ReplicasInfoManagerTest

* style(broker): rename a constant

1. rename a constant

* feat(controller): update the DLedger dependency from v0.27 to v0.30

1. update the DLedger dependency from v0.27 to v0.30

* style(controller): add a white-line just for trigger GitHub action again

1. add a white-line just for trigger GitHub action again

* feat(controller): combine electMaster api and brokerTryElectMaster api

1. combine electMaster api and brokerTryElectMaster api

* feat(controller): add a logic about verifying the broker id returned from registering

1. add a logic about verifying the broker id returned from registering

* fix(controller): remove unused code and add a warning log in ControllerManager

1. remove unused code and add a warning log in ControllerManager

* fix: resolve conflicts

1. resolve conflicts

* fix(controller): remove unused class

1. remove unused class

* fix(controller): Resolve conflicts after merging

1. Resolve conflicts after merging

* refactor(controller): Refactor ReplicasInfoManager#elect

1. Refactor ReplicasInfoManager#elect

* style(controller): remove unused imports

1. remove unused imports

* style(controller): remove unused imports

1. remove unused imports

* fix(controller): resolve conflicts after merging develop branch

1. resolve conflicts after merging develop branch

* rerun

* fix(controller): resolve conflicts in ReplicasInfoManagerTest#testRegisterNewBroker after merging develop branch

1. resolve conflicts in ReplicasInfoManagerTest#testRegisterNewBroker after merging develop branch

* style(controller): pass style check

1. pass style check
2023-03-14 09:40:15 +08:00
loboxu 473e23b1dd Optimize command line tools QueryMsgByKey& QueryMsgTraceById 2023-02-27 12:46:48 +08:00
loboxu 72f458bccd Optimize command line tools QueryMsgByKey& QueryMsgTraceById 2023-02-27 12:46:48 +08:00
loboxu 254deb079a Command line tool QueryMsgByKey& QueryMsgTraceById:time range and number of data bars can be specified 2023-02-27 12:46:48 +08:00
zhouxiang 0f878b5157 [maven-release-plugin] prepare for next development iteration 2023-02-16 12:35:58 +08:00
zhouxiang b8e9334d2a [maven-release-plugin] prepare release rocketmq-all-5.1.0 2023-02-16 12:35:58 +08:00
zhouxiang 83d6778747 [ISSUE #6030] Update version to 5.1.0-SNAPSHOT 2023-02-16 12:35:58 +08:00
Misaki f09771a43c [ISSUE #6084] fixed a typo 2023-02-16 08:45:43 +08:00
rongtong abdf5dcb23 [ISSUE #6045] Fix the issue that the endoffset of entry obtained by getBrokerEpoch is incorrect (#6049)
* Fix the issue that the endoffset of entry obtained by getBrokerEpoch is incorrect

* Fix the issue that the endoffset of entry obtained by getBrokerEpoch is incorrect
2023-02-14 10:08:23 +08:00
Shuangxi Dingand徒钟 869ab5e20e [ISSUE #5975] Fix getUserTopicConfig Impl contains system topic (#5976)
Co-authored-by: 徒钟 <shuangxi.dsx@alibaba-inc.com>
2023-02-09 18:55:54 +08:00
rongtong 0ea930182c GetSyncStateSetSubCommand can also print that the broker is not in syncStateSet (#5935) 2023-01-28 10:08:51 +08:00
Aaron Ai f488e20dc9 Fix logback warning in rmq.tools.logback.xml 2023-01-20 11:52:11 +08:00
BaoCheng Wangandw30003204 5894332918 [ISSUE #5816] fix the issue that No response is returned when no parameter is configured for the brokerStatus command.(#5818) (#5818)
Co-authored-by: w30003204 <wangbaocheng@huawei.com>
2023-01-10 14:49:03 +08:00
rongtong fe59775e37 [ISSUE #5812] Fix the issue that static topic cannot be consumed normally (#5811)
* Fix the issue that static topic cannot be consumed normally

* Fix the issue that static topic cannot be consumed normally
2023-01-04 18:39:29 +08:00
SSpiritsandLi Zhanhui d3de48c806 [ISSUE #5605]Introduce tag estimation for lag calculation (#5606)
* Introduce tag estimation for lag calculation

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>

* fixed according to review comments

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-30 14:52:59 +08:00
zhangjidi2016andzhangjidi 48b7ece986 [ISSUE #4487] The trackType is wrong when the consumer in broadcasting subscription (#5609)
Co-authored-by: zhangjidi <zhangjidi@cmss.chinamobile.com>
2022-11-29 14:08:18 +08:00