370 Commits

Author SHA1 Message Date
zhanghong ca721b0145 [ISSUE #7462] Remove deprecated LocalTransactionExecuter (#7463) 2023-11-21 14:03:24 +08:00
Zhanhui Li 15d32db03b [ISSUE #7547] Let consumer be aware of message queue assignment change (#7548)
* let consumer be aware of message queue assignment change

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* add unit test for DefaultMQPushConsumer#setMessageQueueListener

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: bazel build warnings

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

* fix: set MixCommitlogTest test size as medium

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

* allow cache bazel test results

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix code style issue by removing unused imports

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix #7552

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Signed-off-by: Zhanhui Li <lizhanhui@apache.org>
2023-11-13 09:44:25 +08:00
lk 00965d8c11 [ISSUE #7531] Clear POP_CK when sending messages (#7532) 2023-11-06 09:46:39 +08:00
lk 73b3fde837 [maven-release-plugin] prepare for next development iteration (#7379) 2023-09-22 10:08:59 +08:00
lk 1a681bdf9b [maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377) 2023-09-21 19:58:29 +08:00
Jixiang Jin dddd58d2cc Set experimental_ui_max_stdouterr_bytes to 10MB in bazel (#7348)
* Set experimental_ui_max_stdouterr_bytes to 10MB and Fix IT
2023-09-12 19:17:36 +08:00
Ziyi Tan 0dbd0772b9 [ISSUE #7326] Split the request to register to the nameserver (#7325)
Signed-off-by: Ziy1-Tan <ajb459684460@gmail.com>
2023-09-11 15:48:07 +08:00
guyinyou c100d815d7 [ISSUE #7328] Convergent thread pool creation (#7329)
* Convergence thread pool creation to facilitate subsequent iteration management

* Convergence thread pool creation in ThreadPoolMonitor.java

* fix unit test

* Convergence ThreadPool constructor

* Convergence ScheduledThreadPool constructor

* remove unused import

* Convergence ScheduledThreadPool constructor

* remove unused import

---------
2023-09-11 10:13:56 +08:00
lk 72d796f2b2 [ISSUE #7205] support batch ack for pop orderly (#7206) 2023-08-18 11:55:39 +08:00
fujian-zfj 3a6ef0400c [ISSUE #7064] [RIP-66-1] Support KV(RocksDB) Storage for Metadata (#7092)
* typo int readme[ecosystem]

* rocksdb metadata

* add unit test

* fix testOffsetPersistInMemory

* fix unit test

* fix unit test

* remove unused import

* move RocksDBOffsetSerialize to broker moudle

* Fix bazel build scripts

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Flag QueryMsgByKeyIT as flaky as it fails at frequency: 5 out of 32

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* change public to private of some inner method

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2023-08-05 00:32:11 +08:00
rongtong 047ef7498f Ensuring consistency between broker and nameserver data when deleting a topic (#7066)
Co-authored-by: 尘央 <xinyuzhou.zxy@alibaba-inc.com>
2023-07-25 14:00:22 +08:00
rongtong e369d7deac [maven-release-plugin] prepare for next development iteration (#6939) 2023-06-24 14:31:42 +08:00
rongtong f7425f52f9 [maven-release-plugin] prepare release rocketmq-all-5.1.3 (#6938) 2023-06-24 12:23:11 +08:00
rongtong ad4cc957fb [maven-release-plugin] prepare for next development iteration (#6895) 2023-06-12 19:12:25 +08:00
rongtong 749967baa8 [maven-release-plugin] prepare release rocketmq-all-5.1.2 (#6892) 2023-06-12 17:44:39 +08:00
lk 40ada807b3 [ISSUE #6828] return the number of assignments equal to the number of messageQueues for order consumer (#6829) 2023-05-30 14:01:25 +08:00
lk 9dfd4a9599 [ISSUE #6761] Support reentrant notification orderly for broker (#6762) 2023-05-16 11:32:11 +08:00
rongtong 8aea26ef8f [maven-release-plugin] prepare for next development iteration 2023-05-15 19:48:34 +08:00
rongtong e244ebb99a [maven-release-plugin] prepare release rocketmq-all-5.1.1 (#6763) 2023-05-15 18:51:01 +08:00
Zhouxiang Zhan 0a329ba627 [ISSUE #6699] Make NotificationProcessor use PopLongPollingService (#6700)
* Refector PopLongPollingService

* Use enum PollingResult to replace int value
* Move PopLongPollingService to upper level
* Move wakeUp and polling method into PopLongPollingService

* NotificationProcessor use PopLongPollingService

* Add BORN_TIME check

* add NotificationIT
2023-05-08 11:49:02 +08:00
lk 57642bc630 [ISSUE #6691] Support reentrant pop orderly for broker (#6692) 2023-05-05 15:06:11 +08:00
Robin Han b3868ab606 (fix): logback config path seperator and brokerLogDir default value m… (#6590)
* (fix): logback config path seperator and brokerLogDir default value missing

* (fix): replace / with file.seperator in proxy test logback config

---------

Co-authored-by: Robin Han <robin@Robindendiannao.lan>
2023-04-18 16:48:34 +08:00
hiyo 0faa0a2c7d [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromName… (#6452)
* [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromNameServer parameters

* Fix to make Bazel CI pass

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Fix typo

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2023-03-23 20:30:21 +08:00
TheR1sing3un 19eafc80ff fix(broker): fix wrong test
1. fix wrong test
2023-03-14 09:40:15 +08:00
RongtongJin bbf54f8a71 Modify StorePathMetadata to StorePathBrokerIdentity 2023-03-14 09:40:15 +08:00
RongtongJin 3a141868b7 Fix some typos and log output 2023-03-14 09:40:15 +08:00
TheR1sing3un 5a2aea7997 refactor(controller): remove meaningless attribute MessageStoreConfig#storePathTempMetadata
1. remove meaningless attribute
`MessageStoreConfig#storePathTempMetadata`
2023-03-14 09:40:15 +08:00
TheR1sing3un 5460c77622 test(test): add AutoSwitchRoleIntegration#testBasicWorkWhenControllerShutdown
1. add AutoSwitchRoleIntegration#testBasicWorkWhenControllerShutdown
2023-03-14 09:40:15 +08:00
TheR1sing3un c494a43c52 refactor(controller): optimize some code suggested by reviewer
1. optimize some code suggested by reviewer
2023-03-14 09:40:15 +08:00
TheR1sing3un 46668b4eaf test(broker): add test to verify broker restart with changed address
1. add test to verify broker restart with changed address
2023-03-14 09:40:15 +08:00
TheR1sing3un 3a69aae701 [ISSUE #6023] Add a unit test to verify new register process in broker with controller mode (#6024)
* refactor: simplify getPID (#5962)

* [ISSUE #5923] Add example tiered storage backend service provider (#5926)

* implement example file segment

* add metrics

* add readme

* fix license

* fix tests

* fix links in README.md

* add comment to PosixFileSegment and mark as experimental

* fix test

* optimize image quality

* Remove the useless exception class: MQRedirectException #5963

* [ISSUE #5965] Fix lmqTopicQueueTable initialization (#5968)

* [ISSUE #5965] Fix lmqTopicQueueTable initialization

* [ISSUE #5965] Fix lmqTopicQueueTable initialization

* [ISSUE #5890] Fix dledger logging (#5959)

* Fix dledger logging

* Add bridge into store module

* [ISSUE #5860] Set the value of order when create or update topic (#5861)

* [ISSUE #5939]Adjust the MQClientInstance#sendHeartbeatToAllBroker catch code block log print level from info to warn (#5940)

* [ISSUE #5924] Optimize UtilAll#sleep method (#5925)

* [ISSUE #5924]Optimize UtilAll#sleep method

* polish code

* [ISSUE #5986] optimize the BrokerOuterAPITest class code

Co-authored-by: zhouyunpeng <2474138779@qq.com>

* [ISSUE #5971] Make the internal logs related to the dledger in the controller print to a file separately (#5972)

* Make the internal logs related to the dledger in the controller print to a file separately

* Make the internal logs related to the dledger in the controller print to a file separately

* [ISSUE #5969] Remvoe duplicate deleteUnusedStats in admin processor (#5973)

* [ISSUE #5847] Add checkBlock for hasMsgFromQueue

* [ISSUE #5983] Make consumer support flow control code better (#5984)

* When encountering the flow control code, pull it after 20ms instead of 3s

* When encountering the flow control code, pull it after 20ms instead of 3s

* [ISSUE #5896] feat:add pop consumer example (#5991)

* feat:add pop consumer

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* Update example/src/main/java/org/apache/rocketmq/example/simple/PushConsumer.java

Co-authored-by: Oliver <wqdyxnbd@163.com>

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

* feat:fix

---------

Co-authored-by: mahaitao617 <mahaitao617@mahaitao617deMacBook-Pro.local>
Co-authored-by: Oliver <wqdyxnbd@163.com>

* [ISSUE #5942] Fix the produce count include the quantity of the system topic(#5943)

* [ISSUE #5999] Fix the TopicQueueMappingUtils comments typo (#6000)

* [ISSUE #5996] Optimize the RemotingSerializable class code (#5998)

* simplified RemotingSerializable null check

* optimize the RemotingSerializable class code

* [ISSUE #5994] [RIP-46] add pop and timer metrics (#5995)

* add pop and timer metrics
* fix according to review comment

* test(broker): add ReplicasManagerRegisterTest to test the register process

1. add ReplicasManagerRegisterTest to test the register process

* chore(pom): modify pom.xml to replace mockito with powermock

1. modify pom.xml to replace mockito with powermock

* build(bazel): export powermock in bazel

1. export powermock in bazel

---------

Co-authored-by: Xinda <xdshent@gmail.com>
Co-authored-by: SSpirits <admin@lv5.moe>
Co-authored-by: loboxu <loboxu@tencent.com>
Co-authored-by: pingww <pingw002@gmail.com>
Co-authored-by: Aaron Ai <yangkun.ayk@gmail.com>
Co-authored-by: Slideee <yechun@corp.netease.com>
Co-authored-by: mxsm <ljbmxsm@gmail.com>
Co-authored-by: hardyfish <85128645+hardyfish@users.noreply.github.com>
Co-authored-by: zhouyunpeng <2474138779@qq.com>
Co-authored-by: rongtong <jinrongtong5@163.com>
Co-authored-by: zhiliatom <87265072+zhiliatom@users.noreply.github.com>
Co-authored-by: zhouxiang <zhouxiang.zzx@alibaba-inc.com>
Co-authored-by: mahaitao <15828010639@163.com>
Co-authored-by: mahaitao617 <mahaitao617@mahaitao617deMacBook-Pro.local>
Co-authored-by: Oliver <wqdyxnbd@163.com>
2023-03-14 09:40:15 +08:00
TheR1sing3un f843851788 fix(controller): fix some bug to pass AutoSwitchRoleIntegrationTest
1. fix some bug to pass AutoSwitchRoleIntegrationTest
2023-03-14 09:40:15 +08:00
TheR1sing3un ea71dc545a fix(controller): fix some bug about ignoring new-add event type
1. fix some bug about ignoring new-add event type
2023-03-14 09:40:15 +08:00
mxsm 543c118200 [ISSUE #6060] Optimize AutoSwitchRoleBase#nextPort method (#6068)
* [ISSUE #6060]Optimize AutoSwitchRoleBase#nextPort method

* polish code

* polish code style
2023-03-02 20:01:02 +08:00
hardyfish 33371e5d8e [ISSUE #6145] Modify Collections.sort usage (#6146)
* modify Collections.sort usage

* modify Collections.sort usage
2023-02-28 13:56:03 +08:00
rongtong b24682619c Ignore AutoSwitchRoleIntegrationTest temporarily because it is still flaky (#6144) 2023-02-21 14:01:37 +08:00
zhouxiang 0f878b5157 [maven-release-plugin] prepare for next development iteration 2023-02-16 12:35:58 +08:00
zhouxiang b8e9334d2a [maven-release-plugin] prepare release rocketmq-all-5.1.0 2023-02-16 12:35:58 +08:00
zhouxiang 83d6778747 [ISSUE #6030] Update version to 5.1.0-SNAPSHOT 2023-02-16 12:35:58 +08:00
hardyfish bf3344386b [ISSUE #6073] remove static reference 2023-02-16 08:37:34 +08:00
nowinkey 50651ef8dd Add integration test 2023-02-14 13:50:47 +08:00
nowinkey dcf84e4125 Add integration test and add enableBuildConsumeQueueConcurrently attribute to BrokerConfig class 2023-02-14 13:50:47 +08:00
Zhouxiang Zhan 83c4a8f3f0 Support long polling in rocketmq proxy in the protocol (#5788)
* Add long polling

* Change rocketmq-proto version to 2.0.2

* fix checkstyle

* Fix rocketmq-proto version

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Change pollTime to timeRemaining

* fix test

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-12-30 22:31:01 +08:00
SSpirits 9f8e85bb76 [ISSUE #5754] [RIP-57] Add asynchronous interfaces to MessageStore (#5755)
* [RIP-57] Add asynchronous interfaces to MessageStore

* fix unit test

* Modified according to review comments

* Remove unnecessary stubbing

* Add some other methods to MessageStore

* fix bazel test

* Skip failing test case

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-12-29 09:42:45 +08:00
xiaoyifang 4fdf91f446 [ISSUE #5726] VerifyDelay should break the loop when matched the delayed message. (#5727) 2022-12-18 15:23:16 +08:00
zhouxiang 23c8efd801 [ISSUE #5485] Fix GrpcBaseIT 2022-12-09 19:53:18 +08:00
SSpirits 774bc67520 optimize LagCalculationIT 2022-12-09 16:04:26 +08:00
rongtong cc6614c236 Fix bug that make static topic ITs unable to pass (#5666) 2022-12-08 17:52:51 +08:00
lizhimins 49fc6eded9 [ISSUE #5568] Support long length group and topic for pop mode consumption (#5611)
* [ISSUE #5568] Support long length group and topic for pop mode consumption
Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
2022-12-07 10:26:50 +08:00
rongtong 59acc7d355 Try to make AutoSwitchRoleIntegrationTest more stable (#5638) 2022-12-04 12:17:43 +08:00