Commit Graph
7934 Commits
Author SHA1 Message Date
TheR1sing3un 1ad1c4d825 docs(docs): add docs about how to update to BrokerId version
1. add docs about how to update to BrokerId version
2023-03-14 09:40:15 +08:00
TheR1sing3un 2515ea5f98 fix(admin): print masterBrokerId when calling GetSyncStateSet
1. print masterBrokerId when calling GetSyncStateSet
2023-03-14 09:40:15 +08:00
TheR1sing3un 92fac4c10f fix(store): fix wrong value of MessageStoreConfig#storePathMetadata and storePathTempMetadata
1. fix wrong value of MessageStoreConfig#storePathMetadata and
storePathTempMetadata
2023-03-14 09:40:15 +08:00
TheR1sing3un 358128c078 fix(controller): return failure when receive a heartbeat with empty brokerId
1. return failure when receive a heartbeat with empty brokerId
2023-03-14 09:40:15 +08:00
TheR1sing3un 5460c77622 test(test): add AutoSwitchRoleIntegration#testBasicWorkWhenControllerShutdown
1. add AutoSwitchRoleIntegration#testBasicWorkWhenControllerShutdown
2023-03-14 09:40:15 +08:00
TheR1sing3un c494a43c52 refactor(controller): optimize some code suggested by reviewer
1. optimize some code suggested by reviewer
2023-03-14 09:40:15 +08:00
TheR1sing3un 46668b4eaf test(broker): add test to verify broker restart with changed address
1. add test to verify broker restart with changed address
2023-03-14 09:40:15 +08:00
TheR1sing3un 0c2f480c3a fix(broker): mark unless attribute with @Deprecated
1. mark unless attribute with @Deprecated
2023-03-14 09:40:15 +08:00
+6 3a69aae701 [ISSUE #6023] Add a unit test to verify new register process in broker with controller mode (#6024)
* refactor: simplify getPID (#5962)

* [ISSUE #5923] Add example tiered storage backend service provider (#5926)

* implement example file segment

* add metrics

* add readme

* fix license

* fix tests

* fix links in README.md

* add comment to PosixFileSegment and mark as experimental

* fix test

* optimize image quality

* Remove the useless exception class: MQRedirectException #5963

* [ISSUE #5965] Fix lmqTopicQueueTable initialization (#5968)

* [ISSUE #5965] Fix lmqTopicQueueTable initialization

* [ISSUE #5965] Fix lmqTopicQueueTable initialization

* [ISSUE #5890] Fix dledger logging (#5959)

* Fix dledger logging

* Add bridge into store module

* [ISSUE #5860] Set the value of order when create or update topic (#5861)

* [ISSUE #5939]Adjust the MQClientInstance#sendHeartbeatToAllBroker catch code block log print level from info to warn (#5940)

* [ISSUE #5924] Optimize UtilAll#sleep method (#5925)

* [ISSUE #5924]Optimize UtilAll#sleep method

* polish code

* [ISSUE #5986] optimize the BrokerOuterAPITest class code

Co-authored-by: zhouyunpeng <2474138779@qq.com>

* [ISSUE #5971] Make the internal logs related to the dledger in the controller print to a file separately (#5972)

* Make the internal logs related to the dledger in the controller print to a file separately

* Make the internal logs related to the dledger in the controller print to a file separately

* [ISSUE #5969] Remvoe duplicate deleteUnusedStats in admin processor (#5973)

* [ISSUE #5847] Add checkBlock for hasMsgFromQueue

* [ISSUE #5983] Make consumer support flow control code better (#5984)

* When encountering the flow control code, pull it after 20ms instead of 3s

* When encountering the flow control code, pull it after 20ms instead of 3s

* [ISSUE #5896] feat:add pop consumer example (#5991)

* feat:add pop consumer

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* Update example/src/main/java/org/apache/rocketmq/example/simple/PushConsumer.java

Co-authored-by: Oliver <wqdyxnbd@163.com>

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

---------

Co-authored-by: mahaitao617 <mahaitao617@mahaitao617deMacBook-Pro.local>
Co-authored-by: Oliver <wqdyxnbd@163.com>

* [ISSUE #5942] Fix the produce count include the quantity of the system topic(#5943)

* [ISSUE #5999] Fix the TopicQueueMappingUtils comments typo (#6000)

* [ISSUE #5996] Optimize the RemotingSerializable class code (#5998)

* simplified RemotingSerializable null check

* optimize the RemotingSerializable class code

* [ISSUE #5994] [RIP-46] add pop and timer metrics (#5995)

* add pop and timer metrics
* fix according to review comment

* test(broker): add ReplicasManagerRegisterTest to test the register process

1. add ReplicasManagerRegisterTest to test the register process

* chore(pom): modify pom.xml to replace mockito with powermock

1. modify pom.xml to replace mockito with powermock

* build(bazel): export powermock in bazel

1. export powermock in bazel

---------

Co-authored-by: Xinda <xdshent@gmail.com>
Co-authored-by: SSpirits <admin@lv5.moe>
Co-authored-by: loboxu <loboxu@tencent.com>
Co-authored-by: pingww <pingw002@gmail.com>
Co-authored-by: Aaron Ai <yangkun.ayk@gmail.com>
Co-authored-by: Slideee <yechun@corp.netease.com>
Co-authored-by: mxsm <ljbmxsm@gmail.com>
Co-authored-by: hardyfish <85128645+hardyfish@users.noreply.github.com>
Co-authored-by: zhouyunpeng <2474138779@qq.com>
Co-authored-by: rongtong <jinrongtong5@163.com>
Co-authored-by: zhiliatom <87265072+zhiliatom@users.noreply.github.com>
Co-authored-by: zhouxiang <zhouxiang.zzx@alibaba-inc.com>
Co-authored-by: mahaitao <15828010639@163.com>
Co-authored-by: mahaitao617 <mahaitao617@mahaitao617deMacBook-Pro.local>
Co-authored-by: Oliver <wqdyxnbd@163.com>
2023-03-14 09:40:15 +08:00
TheR1sing3un 03d6ba23e4 style(controller): remove unused import
1. remove unused import
2023-03-14 09:40:15 +08:00
TheR1sing3un f843851788 fix(controller): fix some bug to pass AutoSwitchRoleIntegrationTest
1. fix some bug to pass AutoSwitchRoleIntegrationTest
2023-03-14 09:40:15 +08:00
TheR1sing3un ea71dc545a fix(controller): fix some bug about ignoring new-add event type
1. fix some bug about ignoring new-add event type
2023-03-14 09:40:15 +08:00
TheR1sing3un 01469030e4 fix(controller): fix some bug about wrong type comparison
1. fix some bug about wrong type comparison
2023-03-14 09:40:15 +08:00
TheR1sing3un 11b2cb84a6 feat(broker): fix some bugs to successfully compile project
1. fix some bugs to successfully compile project
2023-03-14 09:40:15 +08:00
TheR1sing3un 1293b74153 feat(broker): perfect ReplicaManagerTest.java
1. perfect ReplicaManagerTest.java
2023-03-14 09:40:15 +08:00
TheR1sing3un c9bf9d7899 feat(broker): perfect logic test in broker
1. perfect logic test in broker
2023-03-14 09:40:15 +08:00
TheR1sing3un b97801c855 feat(controller): Improved logic and adaptation testing for persistent broker id versions
1. Improved logic and adaptation testing for persistent broker id versions
2023-03-14 09:40:15 +08:00
TheR1sing3un a808727768 feat(controller): implement logic about dealing with UpdateBrokerAddress event
1. implement logic about dealing with UpdateBrokerAddress event
2023-03-14 09:40:15 +08:00
TheR1sing3un d7cac1582e feat(controller): implement the general register to controller protocol in controller side
1. implement the general register to controller protocol in controller
side
2023-03-14 09:40:15 +08:00
TheR1sing3un cfdfa0ea51 feat(broker): implement the general register to controller protocol
1. implement the general register to controller protocol
2023-03-14 09:40:15 +08:00
TheR1sing3un f750dec0c7 refactor code in module: store/ha for persistence broker-id
1. refactor code in module: store/ha for persistence broker-id
2023-03-14 09:40:15 +08:00
TheR1sing3un 9577aacbc0 feat(controller): add protocols about new register flow
1. add protocols about new register flow
2023-03-14 09:40:15 +08:00
TheR1sing3un e38ea9510a feat(controller): refactor broker's information recording core from ip address to broker id
1. refactor broker's information recording core from ip address to broker id
2023-03-14 09:40:15 +08:00
RongtongJin 2c2db61e32 Resolve the conflict 2023-03-14 09:40:15 +08:00
TheR1sing3un a1de567e11 [ISSUE#5045] Refactor the register and elect-master process in controller mode (#5046)
* refactor(controller): refactor the register logic

1. refactor the register logic

* refactor(controller): remove unused field in ElectMasterEvent

1. remove unused field in ElectMasterEvent

* feat(controller): add a tryElectMaster request and process logic about it

1. add a tryElectMaster request and process logic about it

* feat(controller): refactor ReplicasInfoManagerTest

1. refactor ReplicasInfoManagerTest

* refactor(controller): refactor DLedgerControllerTest

1. refactor DLedgerControllerTest

* refactor(controller): refactor ControllerManagerTest

1. refactor ControllerManagerTest

* refactor(controller): refactor ReplicasInfoManagerTest

1. refactor ReplicasInfoManagerTest

* refactor(controller): refactor register process and pass the junit test

1. refactor ReplicasInfoManagerTest

* style(broker): rename a constant

1. rename a constant

* feat(controller): update the DLedger dependency from v0.27 to v0.30

1. update the DLedger dependency from v0.27 to v0.30

* style(controller): add a white-line just for trigger GitHub action again

1. add a white-line just for trigger GitHub action again

* feat(controller): combine electMaster api and brokerTryElectMaster api

1. combine electMaster api and brokerTryElectMaster api

* feat(controller): add a logic about verifying the broker id returned from registering

1. add a logic about verifying the broker id returned from registering

* fix(controller): remove unused code and add a warning log in ControllerManager

1. remove unused code and add a warning log in ControllerManager

* fix: resolve conflicts

1. resolve conflicts

* fix(controller): remove unused class

1. remove unused class

* fix(controller): Resolve conflicts after merging

1. Resolve conflicts after merging

* refactor(controller): Refactor ReplicasInfoManager#elect

1. Refactor ReplicasInfoManager#elect

* style(controller): remove unused imports

1. remove unused imports

* style(controller): remove unused imports

1. remove unused imports

* fix(controller): resolve conflicts after merging develop branch

1. resolve conflicts after merging develop branch

* rerun

* fix(controller): resolve conflicts in ReplicasInfoManagerTest#testRegisterNewBroker after merging develop branch

1. resolve conflicts in ReplicasInfoManagerTest#testRegisterNewBroker after merging develop branch

* style(controller): pass style check

1. pass style check
2023-03-14 09:40:15 +08:00
mxsm 37ff93a27b [ISSUE #6331] Optimlize DefaultMQPushConsumerImpl#subscribe method (#6332) 2023-03-14 08:12:53 +08:00
Lobo Xuandloboxu 0732f125f9 Fixed the proxy configuration path null value problem (#6311)
Co-authored-by: loboxu <loboxu@tencent.com>
2023-03-13 14:38:25 +08:00
hzh0425 2cc899fc35 [ISSUE #5663] Fix Messages may be lost when SyncStateSet expand in extreme scenarios (#5798)
* Add a new state 'isSynchronizingSyncStateSet' to Solve the problem of missing messages

* pass checkstyle

* Using readWriteLock to replace synchronized in AutoSwitchHAService

* Fix lock issue

* Remove unnecessary 'remoteSyncStateSet.clear'

* optimize import
2023-03-13 14:22:29 +08:00
mxsm 47355d115d [ISSUE #6272]Add judgment for SendLatencyFault in MQFaultStrategy#selectOneMessageQueue (#6273)
* [ISSUE #6272]Add judgment for SendLatencyFault in MQFaultStrategy#selectOneMessageQueue

* fix code style
2023-03-13 14:19:08 +08:00
rongtong 20dc5c96ea [ISSUE #6316] Nameserver should choose a master with a larger epoch when there are two masters in controller mode (#6317) 2023-03-13 11:16:35 +08:00
Star-tears d0df0518c7 [ISSUE #6308]Fix docs (#6301) 2023-03-13 09:08:26 +08:00
rongtong 9a7d095eac Upgrade dledger version to 0.3.1.1 (#6319) 2023-03-12 09:13:54 +08:00
mxsm 3c770c95ce [ISSUE #6302] Fix DefaultMQPushConsumerImpl code style (#6303) 2023-03-11 16:25:14 +08:00
fujian-zfj 7b23042eb2 [ISSUE #6306] Fix unexpected state from slave (#6307)
* typo int readme[ecosystem]

* fix unexpected state from slave
2023-03-10 13:39:28 +08:00
lyx e599187047 add GET_CONSUMER_CONNECTION_LIST 2023-03-10 11:17:31 +08:00
rongtong 244e8f9158 [ISSUE #6285] Polish the DLedgerControllerStateMachine log output to help troubleshoot 2023-03-09 11:44:13 +08:00
rongtong ba4dd5a21e [ISSUE #6283] Fix the bug that single replica cannot flush data when transientStorePoolEnable is true
[ISSUE #6283] Fix the bug that single replica cannot flush data when transientStorePoolEnable is true
2023-03-09 11:43:38 +08:00
Lobo Xuandloboxu 390070159b [ISSUE #6235] Removed the ForwardRequestProcessors class that is not being used
Co-authored-by: loboxu <loboxu@tencent.com>
2023-03-08 21:55:57 +08:00
hardyfish 5c45294c45 [ISSUE #6189] Replace ThreadFactory create (#6190)
* Replace ThreadFactory create

* delete unnecessary imports

* remove useless import

* reformat code
2023-03-08 20:24:30 +08:00
rongtong 9e0fb1b029 [ISSUE #6169] Fix NPE when timerWheel disabled (#6184)
* Fix some NPE when timerWheel disabled

* Add UT
2023-03-08 17:23:06 +08:00
Lei Zhiyuan 61c4ba5009 [ISSUE #6213] fix: when subscriptionGroupConfig is null ,we do not register consumer 2023-03-08 16:06:28 +08:00
mxsm 98d8988abc [ISSUE #6133]Update the version information to 5.1.0 in README.md (#6134) 2023-03-08 16:06:04 +08:00
Zhouxiang Zhan 1986c6bdf9 [ISSUE #6207] Use static subscription to calculate consumer lag and latency
* Fix retryTopicPerm in ConsumerLagCalculator

* [ISSUE #6206] Use static subscription to calculate consumer lag and latency

* Add version for SimpleSubscriptionData

* Fix hashcode and equals for SubscriptionGroupConfig

* remove brokerId in equal and hashcode method

* Add getter setter for version

* fix consumerGroupInfo and getSubscriptionDataSet npe
2023-03-08 15:47:20 +08:00
Aaron Ai afe6781be6 Remove rbe_default digest check 2023-03-08 14:08:06 +08:00
lk 2b42e16480 [ISSUE #6266] get MessageId from UNIQ_KEY firstly when build system message (#6267) 2023-03-08 09:46:49 +08:00
yuz10 4af6c768fc [ISSUE #6157] Fix incompatibility between 4.x and 5.x in message trace 2023-03-07 08:39:37 +08:00
Aaron Ai 236d4a164e Apply AsyncAppender for broker 2023-03-06 22:20:47 +08:00
Aaron Ai 9214c69d83 Remove unnecessary property[append] for ConsoleAppender 2023-03-06 22:20:47 +08:00
Aaron Ai c9975961f8 Remove uncompatible sed in runserver.sh 2023-03-06 16:08:47 +08:00
Lobo Xuandloboxu b9bbd52060 [ISSUE #6230] Optimizes ScheduleMessageService code and logic (#6231)
Co-authored-by: loboxu <loboxu@tencent.com>
2023-03-06 10:22:29 +08:00