Commit Graph
130 Commits
Author SHA1 Message Date
Zhouxiang Zhan 2043dd5034 [ISSUE #7493] Introduce a new event NettyEventType.ACTIVE (#7494)
* [ISSUE #7493] Introduce a new event NettyEventType.ACTIVE for ChannelEventListener

* introduce a new event NettyEventType.ACTIVE,

* implement channelActive interface for NettyRemotingClient#NettyConnectManageHandler

* add onChannelActive for ChannelEventListener interface.

* Move send heartbeat to onChannelActive
2023-10-24 10:29:43 +08:00
Lei Sun 28427d4012 [ISSUE #7425] Add RoccketmqControllerConsole log to fix bug (#7458) 2023-10-13 13:42:27 +08:00
rongtong b18e564add [ISSUE #7431] Fix flaky test of DLedgerControllerTest#testBrokerLifecycleListener (#7432)
* Fix flaky test of DLedgerControllerTest#testBrokerLifecycleListener
2023-10-09 21:43:01 +08:00
lk 73b3fde837 [maven-release-plugin] prepare for next development iteration (#7379) 2023-09-22 10:08:59 +08:00
lk 1a681bdf9b [maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377) 2023-09-21 19:58:29 +08:00
Jixiang Jin b8610d87bb Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter. (#7373)
* Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter.

* Fix bazel workspace

* Move OtlpJsonLoggingMetricExporter to proxy and controller.

* Fix Bazel imports.
2023-09-21 16:21:44 +08:00
guyinyou c100d815d7 [ISSUE #7328] Convergent thread pool creation (#7329)
* Convergence thread pool creation to facilitate subsequent iteration management

* Convergence thread pool creation in ThreadPoolMonitor.java

* fix unit test

* Convergence ThreadPool constructor

* Convergence ScheduledThreadPool constructor

* remove unused import

* Convergence ScheduledThreadPool constructor

* remove unused import

---------
2023-09-11 10:13:56 +08:00
rongtong 628020537f [ISSUE #7293] Fix NPE when alter sync state set 2023-09-07 16:17:47 +08:00
Jixiang Jin 50d1050437 To config the cardinalityLimit for openTelemetry metrics exporting and fix logging config for metrics (#7196) 2023-08-16 21:15:00 +08:00
rongtong e369d7deac [maven-release-plugin] prepare for next development iteration (#6939) 2023-06-24 14:31:42 +08:00
rongtong f7425f52f9 [maven-release-plugin] prepare release rocketmq-all-5.1.3 (#6938) 2023-06-24 12:23:11 +08:00
rongtong ad4cc957fb [maven-release-plugin] prepare for next development iteration (#6895) 2023-06-12 19:12:25 +08:00
rongtong 749967baa8 [maven-release-plugin] prepare release rocketmq-all-5.1.2 (#6892) 2023-06-12 17:44:39 +08:00
TheR1sing3un c68fb8f1b9 [ISSUE #6845] Build controller with bazel (#6846) 2023-06-01 13:42:52 +08:00
TheR1sing3un 529976f8fb [ISSUE #6777] Support metric in controller (#6778)
* feat(controller): build metrics framework in controller module

1. build metrics framework in controller module

* feat(controller): record metrics about controller

1. record metrics about controller

* fix(controller): fix after review

1. fix after review

Closes https://github.com/apache/rocketmq/issues/6777

* fix(controller): fix after review

1. fix lack of dependency

Closes https://github.com/apache/rocketmq/issues/6777
2023-05-30 14:17:59 +08:00
rongtong 8aea26ef8f [maven-release-plugin] prepare for next development iteration 2023-05-15 19:48:34 +08:00
rongtong e244ebb99a [maven-release-plugin] prepare release rocketmq-all-5.1.1 (#6763) 2023-05-15 18:51:01 +08:00
rongtong 9d411cf04a Make configPath unable to update at runtime (#6733)
* Make configPath unable to update at runtime

* Make configPath unable to update at runtime

* Add ASF header

* Add ASF header

* Pass the check style

* Polish the response code

* Polish the response code
2023-05-11 18:01:29 +08:00
Robin HanandRobin Han b3868ab606 (fix): logback config path seperator and brokerLogDir default value m… (#6590)
* (fix): logback config path seperator and brokerLogDir default value missing

* (fix): replace / with file.seperator in proxy test logback config

---------

Co-authored-by: Robin Han <robin@Robindendiannao.lan>
2023-04-18 16:48:34 +08:00
hiyoandLi Zhanhui 0faa0a2c7d [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromName… (#6452)
* [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromNameServer parameters

* Fix to make Bazel CI pass

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Fix typo

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2023-03-23 20:30:21 +08:00
TheR1sing3un 1e2a301266 [ISSUE #6382] Periodically check for inactive masters (#6383)
* feat(controller): concurrent protect ReplicasInfoManager#replicaInfoTable and ReplicasInfoManager#syncStateSetInfoTable

1. concurrent protect ReplicasInfoManager#replicaInfoTable and
ReplicasInfoManager#syncStateSetInfoTable

* docs(controller): make statemachine thread-safe and support timed checking inactive master in each broker-set

1. make statemachine thread-safe
2. support timed checking inactive
master in each broker-set

* fix(controller): Add some logic when visit the BrokerReplicaInfo to avoid NPE

1. Add some logic when visit the BrokerReplicaInfo to avoid NPE

* test(controller): polish some test logic

1. polish some test logic

* fix(controller): Revise back the ControllerConfig#controllerStorePath to avoid the Incompatibility problems

1. Revise back the ControllerConfig#controllerStorePath to avoid the
Incompatibility problems
2023-03-21 13:59:53 +08:00
Ji Juntao f1e02e8947 [ISSUE #6392] GetSyncStateSet prints replica's alive status (#6393)
* print replica's alive status

* refactor

* rename getIsAlive-getAlive and setIsAlive-setAlive.
2023-03-20 13:53:07 +08:00
Ji Juntao 63a014b810 [ISSUE#6342] Local SyncStatSet sync to remote value when changeToMaster (#6352)
* fix ISSUE#6342

* refactor

* correct the syncStateSet in elect process.

* move syncStateSet into request/response's body.

* optimize the broker electing switch's branch.
2023-03-16 11:48:04 +08:00
TheR1sing3un 52c4c0cdf6 [ISSUE #6346] Support asynchronously notify brokers when their roles has been changed (#6348)
* feat(controller): support asynchronous notify brokers when roles changed

1. support asynchronous notify brokers when roles changed

* refactor(controller): move creating NotifyService instance logic to ControllerManager's constructor method

1. move creating NotifyService instance logic to ControllerManager's
constructor method
2023-03-15 13:50:06 +08:00
TheR1sing3un 483ba12cae test(controller): To pass ControllerManagerTest in Windows, we forbid the controller to notify the brokers when their roles have been changed.
1. To pass `ControllerManagerTest` in Windows,  we forbid the controller to notify the brokers when their roles have been changed.
2023-03-14 09:40:15 +08:00
TheR1sing3un 10147debf5 test(broker): optimize some test base store path
1. optimize some test base store path
2023-03-14 09:40:15 +08:00
TheR1sing3un 600d873fba test(controller): try to fix flaky test 2023-03-14 09:40:15 +08:00
TheR1sing3un e14158c7ff fix(controller): fix forgetting initialize BrokerHeartbeatManager
1. fix forgetting initialize BrokerHeartbeatManager
2023-03-14 09:40:15 +08:00
TheR1sing3un 19eafc80ff fix(broker): fix wrong test
1. fix wrong test
2023-03-14 09:40:15 +08:00
RongtongJin 28618e95ab Polish the code structure and code style 2023-03-14 09:40:15 +08:00
RongtongJin 3a141868b7 Fix some typos and log output 2023-03-14 09:40:15 +08:00
TheR1sing3un 358128c078 fix(controller): return failure when receive a heartbeat with empty brokerId
1. return failure when receive a heartbeat with empty brokerId
2023-03-14 09:40:15 +08:00
TheR1sing3un c494a43c52 refactor(controller): optimize some code suggested by reviewer
1. optimize some code suggested by reviewer
2023-03-14 09:40:15 +08:00
TheR1sing3un 46668b4eaf test(broker): add test to verify broker restart with changed address
1. add test to verify broker restart with changed address
2023-03-14 09:40:15 +08:00
TheR1sing3un 03d6ba23e4 style(controller): remove unused import
1. remove unused import
2023-03-14 09:40:15 +08:00
TheR1sing3un f843851788 fix(controller): fix some bug to pass AutoSwitchRoleIntegrationTest
1. fix some bug to pass AutoSwitchRoleIntegrationTest
2023-03-14 09:40:15 +08:00
TheR1sing3un ea71dc545a fix(controller): fix some bug about ignoring new-add event type
1. fix some bug about ignoring new-add event type
2023-03-14 09:40:15 +08:00
TheR1sing3un 01469030e4 fix(controller): fix some bug about wrong type comparison
1. fix some bug about wrong type comparison
2023-03-14 09:40:15 +08:00
TheR1sing3un 11b2cb84a6 feat(broker): fix some bugs to successfully compile project
1. fix some bugs to successfully compile project
2023-03-14 09:40:15 +08:00
TheR1sing3un 1293b74153 feat(broker): perfect ReplicaManagerTest.java
1. perfect ReplicaManagerTest.java
2023-03-14 09:40:15 +08:00
TheR1sing3un b97801c855 feat(controller): Improved logic and adaptation testing for persistent broker id versions
1. Improved logic and adaptation testing for persistent broker id versions
2023-03-14 09:40:15 +08:00
TheR1sing3un a808727768 feat(controller): implement logic about dealing with UpdateBrokerAddress event
1. implement logic about dealing with UpdateBrokerAddress event
2023-03-14 09:40:15 +08:00
TheR1sing3un d7cac1582e feat(controller): implement the general register to controller protocol in controller side
1. implement the general register to controller protocol in controller
side
2023-03-14 09:40:15 +08:00
TheR1sing3un cfdfa0ea51 feat(broker): implement the general register to controller protocol
1. implement the general register to controller protocol
2023-03-14 09:40:15 +08:00
TheR1sing3un 9577aacbc0 feat(controller): add protocols about new register flow
1. add protocols about new register flow
2023-03-14 09:40:15 +08:00
TheR1sing3un e38ea9510a feat(controller): refactor broker's information recording core from ip address to broker id
1. refactor broker's information recording core from ip address to broker id
2023-03-14 09:40:15 +08:00
RongtongJin 2c2db61e32 Resolve the conflict 2023-03-14 09:40:15 +08:00
TheR1sing3un a1de567e11 [ISSUE#5045] Refactor the register and elect-master process in controller mode (#5046)
* refactor(controller): refactor the register logic

1. refactor the register logic

* refactor(controller): remove unused field in ElectMasterEvent

1. remove unused field in ElectMasterEvent

* feat(controller): add a tryElectMaster request and process logic about it

1. add a tryElectMaster request and process logic about it

* feat(controller): refactor ReplicasInfoManagerTest

1. refactor ReplicasInfoManagerTest

* refactor(controller): refactor DLedgerControllerTest

1. refactor DLedgerControllerTest

* refactor(controller): refactor ControllerManagerTest

1. refactor ControllerManagerTest

* refactor(controller): refactor ReplicasInfoManagerTest

1. refactor ReplicasInfoManagerTest

* refactor(controller): refactor register process and pass the junit test

1. refactor ReplicasInfoManagerTest

* style(broker): rename a constant

1. rename a constant

* feat(controller): update the DLedger dependency from v0.27 to v0.30

1. update the DLedger dependency from v0.27 to v0.30

* style(controller): add a white-line just for trigger GitHub action again

1. add a white-line just for trigger GitHub action again

* feat(controller): combine electMaster api and brokerTryElectMaster api

1. combine electMaster api and brokerTryElectMaster api

* feat(controller): add a logic about verifying the broker id returned from registering

1. add a logic about verifying the broker id returned from registering

* fix(controller): remove unused code and add a warning log in ControllerManager

1. remove unused code and add a warning log in ControllerManager

* fix: resolve conflicts

1. resolve conflicts

* fix(controller): remove unused class

1. remove unused class

* fix(controller): Resolve conflicts after merging

1. Resolve conflicts after merging

* refactor(controller): Refactor ReplicasInfoManager#elect

1. Refactor ReplicasInfoManager#elect

* style(controller): remove unused imports

1. remove unused imports

* style(controller): remove unused imports

1. remove unused imports

* fix(controller): resolve conflicts after merging develop branch

1. resolve conflicts after merging develop branch

* rerun

* fix(controller): resolve conflicts in ReplicasInfoManagerTest#testRegisterNewBroker after merging develop branch

1. resolve conflicts in ReplicasInfoManagerTest#testRegisterNewBroker after merging develop branch

* style(controller): pass style check

1. pass style check
2023-03-14 09:40:15 +08:00
rongtong 244e8f9158 [ISSUE #6285] Polish the DLedgerControllerStateMachine log output to help troubleshoot 2023-03-09 11:44:13 +08:00
rongtong d5d5a637f6 [ISSUE #6226] Shutdown flowMonitor when connection disconnect (#6227)
* Shutdown flowMonitor when connection disconnect

* Whether the master is existed has more accurate judgment

* Shutdown flowMonitor when HAClient service end

* Pass the check style

* Modify according to comments
2023-03-03 22:28:15 +08:00