Commit Graph

144 Commits

Author SHA1 Message Date
lizhimins 47fe6b2ba6 [maven-release-plugin] prepare for next development iteration (#9232) 2025-03-08 17:20:49 +08:00
lizhimins 2baaf044ea [maven-release-plugin] prepare release rocketmq-all-5.3.2 (#9231) 2025-03-08 14:07:17 +08:00
luozongle01 b7a2a3dc39 [ISSUE #8769] Fix doc typo (#8770) 2024-09-29 09:54:15 +08:00
lizhimins daf3d1a666 [maven-release-plugin] prepare for next development iteration (#8750) 2024-09-26 09:33:52 +08:00
lizhimins b122c8109d [maven-release-plugin] prepare release rocketmq-all-5.3.1 (#8749) 2024-09-25 23:24:56 +08:00
dinglei cc484d5680 [ISSUE #8454] Active brokers number should be initailized to 1 in broker heartbeat manager. (#8453)
* active brokers should be 1 on computing if absent

* active brokers number should be initailized to 1 in broker heartbeat manager.
2024-07-28 17:12:59 +08:00
lizhimins 5dc0c6a8b5 [maven-release-plugin] prepare for next development iteration (#8382) 2024-07-09 01:30:43 +08:00
lizhimins 7ee50ec32e [maven-release-plugin] prepare release rocketmq-all-5.3.0 (#8379) 2024-07-08 23:15:33 +08:00
cnScarb a15088cbd3 [ISSUE #8096] fix log placeholder 2024-05-07 09:49:43 +08:00
rongtong f41160210a [maven-release-plugin] prepare for next development iteration (#7828) 2024-02-12 11:07:03 +08:00
rongtong 281a7b32f0 [maven-release-plugin] prepare release rocketmq-all-5.2.0 (#7827) 2024-02-11 17:53:50 +08:00
bazelisky af1936d93a [ISSUE #7715] Update Bazel toolchain to make the CI work (#7714)
* Update bazel toolchain

Signed-off-by: Bazelisky <bazelisk@hotmail.com>

* fix a bad test case as it violates requirement of ConcurrentHashMap#computeIfAbsent

Signed-off-by: Bazelisky <bazelisk@hotmail.com>

* Exclude flaky tests from test suite

Signed-off-by: bazelisky <155456828+bazelisky@users.noreply.github.com>

* fix: format issue

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* fix: Remove unused import

* fix deps issue

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* Expose data property of java_test, allowing to specify run_file

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

---------

Signed-off-by: Bazelisky <bazelisk@hotmail.com>
Signed-off-by: bazelisky <155456828+bazelisky@users.noreply.github.com>
Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>
Co-authored-by: Zhanhui Li <lizhanhui@gmail.com>
2024-02-01 16:52:55 +08:00
yulangz 8df53dfde8 [ISSUE #7300] jRaft-Controller Implemention (#7301)
* jRaft-Controller Implemention

* fix bazel build

* reformat code

* remove fury dependence

* fix bazel build

* resolve conflict

* clear code

* Optimize code style

* Optimize code style

* Optimize code style

* revert style only change
fix code style
rollback an unexpected modification.

* Update Producer.java

* chore: move raft startup to start method

* chore: use jraftconfig to collect all configs about jraft

* fix: fix wrong store path because init use string constant

* fix: fix CONTROLLER_NOT_LEADER error in follower

* chore: seperate jraft and controller log

* chore: fix conflict with develop

* chore: add comment to clear the filter logic

* feat: triggerElectMaster will retry when failed

* feat: when controller all restart, we use a timestamp to trace the first heartbeat, avoid to elect again

* fix: implements Serializable to enable snapshot serialize

* fix: use for loop to simple the elect retry

* chore: update jraft version

* chore: opt import

---------

Co-authored-by: leizhiyuan <leizhiyuan@gmail.com>
2024-01-29 20:45:20 +08:00
dinglei 9cfe724e6a Add validation in broker/namesrv configure updating command (#7584)
* Add validation for keys in black list in mqadmin command.

* Cancel validation for keys in black list in putKV command.
2023-11-28 10:04:17 +08:00
Zhouxiang Zhan 2043dd5034 [ISSUE #7493] Introduce a new event NettyEventType.ACTIVE (#7494)
* [ISSUE #7493] Introduce a new event NettyEventType.ACTIVE for ChannelEventListener

* introduce a new event NettyEventType.ACTIVE,

* implement channelActive interface for NettyRemotingClient#NettyConnectManageHandler

* add onChannelActive for ChannelEventListener interface.

* Move send heartbeat to onChannelActive
2023-10-24 10:29:43 +08:00
Lei Sun 28427d4012 [ISSUE #7425] Add RoccketmqControllerConsole log to fix bug (#7458) 2023-10-13 13:42:27 +08:00
rongtong b18e564add [ISSUE #7431] Fix flaky test of DLedgerControllerTest#testBrokerLifecycleListener (#7432)
* Fix flaky test of DLedgerControllerTest#testBrokerLifecycleListener
2023-10-09 21:43:01 +08:00
lk 73b3fde837 [maven-release-plugin] prepare for next development iteration (#7379) 2023-09-22 10:08:59 +08:00
lk 1a681bdf9b [maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377) 2023-09-21 19:58:29 +08:00
Jixiang Jin b8610d87bb Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter. (#7373)
* Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter.

* Fix bazel workspace

* Move OtlpJsonLoggingMetricExporter to proxy and controller.

* Fix Bazel imports.
2023-09-21 16:21:44 +08:00
guyinyou c100d815d7 [ISSUE #7328] Convergent thread pool creation (#7329)
* Convergence thread pool creation to facilitate subsequent iteration management

* Convergence thread pool creation in ThreadPoolMonitor.java

* fix unit test

* Convergence ThreadPool constructor

* Convergence ScheduledThreadPool constructor

* remove unused import

* Convergence ScheduledThreadPool constructor

* remove unused import

---------
2023-09-11 10:13:56 +08:00
rongtong 628020537f [ISSUE #7293] Fix NPE when alter sync state set 2023-09-07 16:17:47 +08:00
Jixiang Jin 50d1050437 To config the cardinalityLimit for openTelemetry metrics exporting and fix logging config for metrics (#7196) 2023-08-16 21:15:00 +08:00
rongtong e369d7deac [maven-release-plugin] prepare for next development iteration (#6939) 2023-06-24 14:31:42 +08:00
rongtong f7425f52f9 [maven-release-plugin] prepare release rocketmq-all-5.1.3 (#6938) 2023-06-24 12:23:11 +08:00
rongtong ad4cc957fb [maven-release-plugin] prepare for next development iteration (#6895) 2023-06-12 19:12:25 +08:00
rongtong 749967baa8 [maven-release-plugin] prepare release rocketmq-all-5.1.2 (#6892) 2023-06-12 17:44:39 +08:00
TheR1sing3un c68fb8f1b9 [ISSUE #6845] Build controller with bazel (#6846) 2023-06-01 13:42:52 +08:00
TheR1sing3un 529976f8fb [ISSUE #6777] Support metric in controller (#6778)
* feat(controller): build metrics framework in controller module

1. build metrics framework in controller module

* feat(controller): record metrics about controller

1. record metrics about controller

* fix(controller): fix after review

1. fix after review

Closes https://github.com/apache/rocketmq/issues/6777

* fix(controller): fix after review

1. fix lack of dependency

Closes https://github.com/apache/rocketmq/issues/6777
2023-05-30 14:17:59 +08:00
rongtong 8aea26ef8f [maven-release-plugin] prepare for next development iteration 2023-05-15 19:48:34 +08:00
rongtong e244ebb99a [maven-release-plugin] prepare release rocketmq-all-5.1.1 (#6763) 2023-05-15 18:51:01 +08:00
rongtong 9d411cf04a Make configPath unable to update at runtime (#6733)
* Make configPath unable to update at runtime

* Make configPath unable to update at runtime

* Add ASF header

* Add ASF header

* Pass the check style

* Polish the response code

* Polish the response code
2023-05-11 18:01:29 +08:00
Robin Han b3868ab606 (fix): logback config path seperator and brokerLogDir default value m… (#6590)
* (fix): logback config path seperator and brokerLogDir default value missing

* (fix): replace / with file.seperator in proxy test logback config

---------

Co-authored-by: Robin Han <robin@Robindendiannao.lan>
2023-04-18 16:48:34 +08:00
hiyo 0faa0a2c7d [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromName… (#6452)
* [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromNameServer parameters

* Fix to make Bazel CI pass

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Fix typo

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2023-03-23 20:30:21 +08:00
TheR1sing3un 1e2a301266 [ISSUE #6382] Periodically check for inactive masters (#6383)
* feat(controller): concurrent protect ReplicasInfoManager#replicaInfoTable and ReplicasInfoManager#syncStateSetInfoTable

1. concurrent protect ReplicasInfoManager#replicaInfoTable and
ReplicasInfoManager#syncStateSetInfoTable

* docs(controller): make statemachine thread-safe and support timed checking inactive master in each broker-set

1. make statemachine thread-safe
2. support timed checking inactive
master in each broker-set

* fix(controller): Add some logic when visit the BrokerReplicaInfo to avoid NPE

1. Add some logic when visit the BrokerReplicaInfo to avoid NPE

* test(controller): polish some test logic

1. polish some test logic

* fix(controller): Revise back the ControllerConfig#controllerStorePath to avoid the Incompatibility problems

1. Revise back the ControllerConfig#controllerStorePath to avoid the
Incompatibility problems
2023-03-21 13:59:53 +08:00
Ji Juntao f1e02e8947 [ISSUE #6392] GetSyncStateSet prints replica's alive status (#6393)
* print replica's alive status

* refactor

* rename getIsAlive-getAlive and setIsAlive-setAlive.
2023-03-20 13:53:07 +08:00
Ji Juntao 63a014b810 [ISSUE#6342] Local SyncStatSet sync to remote value when changeToMaster (#6352)
* fix ISSUE#6342

* refactor

* correct the syncStateSet in elect process.

* move syncStateSet into request/response's body.

* optimize the broker electing switch's branch.
2023-03-16 11:48:04 +08:00
TheR1sing3un 52c4c0cdf6 [ISSUE #6346] Support asynchronously notify brokers when their roles has been changed (#6348)
* feat(controller): support asynchronous notify brokers when roles changed

1. support asynchronous notify brokers when roles changed

* refactor(controller): move creating NotifyService instance logic to ControllerManager's constructor method

1. move creating NotifyService instance logic to ControllerManager's
constructor method
2023-03-15 13:50:06 +08:00
TheR1sing3un 483ba12cae test(controller): To pass ControllerManagerTest in Windows, we forbid the controller to notify the brokers when their roles have been changed.
1. To pass `ControllerManagerTest` in Windows,  we forbid the controller to notify the brokers when their roles have been changed.
2023-03-14 09:40:15 +08:00
TheR1sing3un 10147debf5 test(broker): optimize some test base store path
1. optimize some test base store path
2023-03-14 09:40:15 +08:00
TheR1sing3un 600d873fba test(controller): try to fix flaky test 2023-03-14 09:40:15 +08:00
TheR1sing3un e14158c7ff fix(controller): fix forgetting initialize BrokerHeartbeatManager
1. fix forgetting initialize BrokerHeartbeatManager
2023-03-14 09:40:15 +08:00
TheR1sing3un 19eafc80ff fix(broker): fix wrong test
1. fix wrong test
2023-03-14 09:40:15 +08:00
RongtongJin 28618e95ab Polish the code structure and code style 2023-03-14 09:40:15 +08:00
RongtongJin 3a141868b7 Fix some typos and log output 2023-03-14 09:40:15 +08:00
TheR1sing3un 358128c078 fix(controller): return failure when receive a heartbeat with empty brokerId
1. return failure when receive a heartbeat with empty brokerId
2023-03-14 09:40:15 +08:00
TheR1sing3un c494a43c52 refactor(controller): optimize some code suggested by reviewer
1. optimize some code suggested by reviewer
2023-03-14 09:40:15 +08:00
TheR1sing3un 46668b4eaf test(broker): add test to verify broker restart with changed address
1. add test to verify broker restart with changed address
2023-03-14 09:40:15 +08:00
TheR1sing3un 03d6ba23e4 style(controller): remove unused import
1. remove unused import
2023-03-14 09:40:15 +08:00
TheR1sing3un f843851788 fix(controller): fix some bug to pass AutoSwitchRoleIntegrationTest
1. fix some bug to pass AutoSwitchRoleIntegrationTest
2023-03-14 09:40:15 +08:00