Commit Graph
41 Commits
Author SHA1 Message Date
zhouxiang 0f878b5157 [maven-release-plugin] prepare for next development iteration 2023-02-16 12:35:58 +08:00
zhouxiang b8e9334d2a [maven-release-plugin] prepare release rocketmq-all-5.1.0 2023-02-16 12:35:58 +08:00
zhouxiang 83d6778747 [ISSUE #6030] Update version to 5.1.0-SNAPSHOT 2023-02-16 12:35:58 +08:00
Aaron Ai ff8c4c856d [ISSUE #5890] Fix dledger logging (#5959)
* Fix dledger logging

* Add bridge into store module
2023-02-03 14:12:23 +08:00
Oliver 37f83124b3 [ISSUE #5900] Fix the problem of can not remove the broker successfully when a shutdown failure (#5901) 2023-01-18 10:23:46 +08:00
Oliver e662715e13 [ISSUE #5897] Polish exception info when broker has already been added to broker container (#5898) 2023-01-17 16:13:38 +08:00
Aaron Ai ffb4a3664e Apply MDC in broker container mode (#5587) 2022-11-24 19:32:07 +08:00
Aaron Ai 4469fb51dd Update group id of rocketmq logging (#5564) 2022-11-22 11:31:21 +08:00
Aaron Ai a68078fef8 [ISSUE #5484] Replace logging module with the shaded logback (#5540)
* Replace logging module with the shaded logback

* Add license header

* Fix bazel compile issue
2022-11-21 16:30:15 +08:00
yukon 506b563f55 Revert "[ISSUE #5484] Replace Logging Module with Shaded Logback (#5524)" (#5537)
This reverts commit 809ff6b3e0.
2022-11-17 20:04:17 +08:00
Aaron AiandLi Zhanhui 809ff6b3e0 [ISSUE #5484] Replace Logging Module with Shaded Logback (#5524)
* Remove ClientLogger

* WIP

* WIP

* Rename logger to log

* Make it compile

* WIP

* Fix bazel to use shaded slf4j

* Fix DeleteExpiredCommitLogSubCommandTest

* Fix pom.xml duplication

* Fix maven deps

* Add test logback configuration file

* Fix unit test output

* Fix logback configuration file

* All logging are made on top of slf4j

* Fix test log configuration file name

* Fix test log configuration file name for test module

* All logging are shaded slf4j targeted

* DLedger has an explicit dependency on slf4j

* Fix DLedger

* Fix DLeader issue

* Move logback configuration files to each module

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-17 00:38:28 +08:00
SSpiritsandLi Zhanhui ec5d3236f6 invert dependency between remoting and common module (#5503)
* invert dependency between remoting and common module

* fix bazel

* Fix Bazel warning of indirect dependency

* remove duplicate class ServiceThread

* fix conflict

* revert delete class ServiceThread because of introduced by dledger

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-11 13:34:31 +08:00
NowinkeyandZhanhui Li 53e0847528 [ISSUE #5204] Enable checkstyle for test code (all module) (#5297)
* delete the checkstyle plugin for child modules

* [ISSUE #5204] Enable checkstyle for test code (all module)

* Exclude generated files

Co-authored-by: Zhanhui Li <lizhanhui@apache.org>
2022-10-14 10:58:48 +08:00
echooymxq 9e63f09ad8 [ISSUE #5285] Support vm arguments to set useTLS value. (#5286) 2022-10-12 14:34:01 +08:00
lizhiminsand斜阳 a3e596550d [ISSUE #5180] Support domain resolution to obtain the nameserver address (#5189)
* [ISSUE #5180] Support domain resolution to obtain the nameserver address

* [ISSUE #5180] Support domain resolution to obtain the nameserver address

Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
2022-09-26 19:15:29 +08:00
hill ac82378aea [maven-release-plugin] prepare for next development iteration 2022-09-19 10:27:17 +08:00
hill f3e113cb1f [maven-release-plugin] prepare release rocketmq-all-5.0.0 2022-09-19 10:26:58 +08:00
Zhanhui Li ac7e4cbfc9 Sync DLedger version in Bazel scripts (#5102)
* Use dledger from maven

* Sync other references
2022-09-19 10:10:26 +08:00
Aaron Ai 4661e58ebe [ISSUE #4934] Checking for violations as part of build (#4935)
* Checking for violations as part of build

* Extend await time for FileWatchServiceTest#watchTwoFiles_ModifyOne
2022-08-31 10:55:04 +08:00
Aaron Ai f23fdbe016 Replace findbugs by spotbugs (#4931) 2022-08-30 17:45:56 +08:00
rongtong 1cc7afd6af Increase initial delay time to fix scheduledTask refresh metadata exception when broker start (#4901) 2022-08-26 18:04:09 +08:00
Zhanhui Li 3da7ea9c1b [Infra Improvement] Build And Run Unit Tests in Parallel (#4878)
* Support build with Bazel (#4865)

* Support build with Bazel, fixing tests to make them capable of running in concurrency and hermetic.

* Make test cases capable of running in parallel. (#4874)
2022-08-24 20:53:30 +08:00
caigy 10d291846e [ISSUE #4832] Remove innerProducer and innerConsumer in EscapeBridge (#4834)
* remove innerProducer and innerConsumer in Escape
 #4832

* format code to pass code-style check

* Move topic route management logic to TopicRouteInfoManager

* Use ThreadPoolExecutor instead of creating a new ForkJoinPool

* remove retry logic

* remove unnecessary name server list

* remove unnecessary invokeId

* remove AssignmentManager and make maintenance of topic subscribe data lazy-initialized

* simply code

* remove unnecessary code
2022-08-24 15:18:51 +08:00
RongtongJin bbbb96e129 Revert "Support build with Bazel (#4865)"
This reverts commit ec8a93d2f7.
2022-08-23 14:29:46 +08:00
Zhanhui Li ec8a93d2f7 Support build with Bazel (#4865)
* Support build with Bazel, fixing tests to make them capable of running in concurrency and hermetic.
2022-08-23 13:11:53 +08:00
Aaron Ai 61b14c3f4e [ISSUE #4785] Enable misspell check GitHub Action (#4786)
* Enable misspell check GitHub Action

* Fix typo
2022-08-08 09:28:41 +08:00
mxsmandAaron Ai b875b3309a [ISSUE #4709] fix method is on the same line as @Override annotation (#4717)
Co-authored-by: Aaron Ai <yangkun.ayk@gmail.com>
2022-08-01 20:42:34 +08:00
RongtongJin b6fac74443 Merge branch 'develop-merge-5.0.0' into 5.0.0-beta-dledger-controller
# Conflicts:
#	.travis.yml
2022-07-12 14:33:55 +08:00
RongtongJin 8ef151d605 Change rocketmq version to 5.0.0-SNAPSHOT in all pom files 2022-07-08 23:45:55 +08:00
RongtongJin a55a621594 Merge branch 'develop-merge-5.0.0' into 5.0.0-beta-dledger-controller
# Conflicts:
#	broker/src/main/java/org/apache/rocketmq/broker/processor/AdminBrokerProcessor.java
#	common/src/main/java/org/apache/rocketmq/common/protocol/RequestCode.java
#	store/src/main/java/org/apache/rocketmq/store/config/MessageStoreConfig.java
#	tools/src/main/java/org/apache/rocketmq/tools/command/MQAdminStartup.java
2022-07-08 15:35:41 +08:00
RongtongJin 3fadc8f30c Merge branch '5.0.0-beta' into develop
# Conflicts:
#	acl/pom.xml
#	broker/pom.xml
#	broker/src/main/java/org/apache/rocketmq/broker/BrokerController.java
#	broker/src/main/java/org/apache/rocketmq/broker/out/BrokerOuterAPI.java
#	broker/src/main/java/org/apache/rocketmq/broker/plugin/MessageStoreFactory.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/AbstractSendMessageProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/AdminBrokerProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/ClientManageProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/ConsumerManageProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/EndTransactionProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/ForwardRequestProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/PullMessageProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/QueryMessageProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/processor/SendMessageProcessor.java
#	broker/src/main/java/org/apache/rocketmq/broker/transaction/jdbc/JDBCTransactionStore.java
#	broker/src/test/java/org/apache/rocketmq/broker/processor/SendMessageProcessorTest.java
#	client/pom.xml
#	client/src/main/java/org/apache/rocketmq/client/consumer/rebalance/AllocateMessageQueueAveragely.java
#	client/src/main/java/org/apache/rocketmq/client/consumer/rebalance/AllocateMessageQueueAveragelyByCircle.java
#	client/src/main/java/org/apache/rocketmq/client/impl/MQClientAPIImpl.java
#	client/src/main/java/org/apache/rocketmq/client/impl/consumer/DefaultMQPushConsumerImpl.java
#	client/src/main/java/org/apache/rocketmq/client/impl/consumer/RebalanceImpl.java
#	client/src/test/java/org/apache/rocketmq/client/consumer/DefaultLitePullConsumerTest.java
#	common/pom.xml
#	common/src/main/java/org/apache/rocketmq/common/MQVersion.java
#	common/src/main/java/org/apache/rocketmq/common/protocol/RequestCode.java
#	common/src/main/java/org/apache/rocketmq/common/protocol/header/PullMessageRequestHeader.java
#	common/src/main/java/org/apache/rocketmq/common/protocol/route/BrokerData.java
#	common/src/main/java/org/apache/rocketmq/common/protocol/route/TopicRouteData.java
#	common/src/main/java/org/apache/rocketmq/common/sysflag/MessageSysFlag.java
#	common/src/main/java/org/apache/rocketmq/common/utils/ServiceProvider.java
#	common/src/test/java/org/apache/rocketmq/common/message/MessageDecoderTest.java
#	distribution/pom.xml
#	example/pom.xml
#	filter/pom.xml
#	logging/pom.xml
#	logging/src/main/java/org/apache/rocketmq/logging/inner/Level.java
#	namesrv/pom.xml
#	namesrv/src/main/java/org/apache/rocketmq/namesrv/NamesrvController.java
#	namesrv/src/main/java/org/apache/rocketmq/namesrv/processor/DefaultRequestProcessor.java
#	namesrv/src/main/java/org/apache/rocketmq/namesrv/routeinfo/RouteInfoManager.java
#	openmessaging/pom.xml
#	pom.xml
#	remoting/pom.xml
#	remoting/src/main/java/org/apache/rocketmq/remoting/netty/NettyRemotingAbstract.java
#	remoting/src/main/java/org/apache/rocketmq/remoting/netty/NettyRemotingClient.java
#	remoting/src/main/java/org/apache/rocketmq/remoting/protocol/RemotingCommand.java
#	remoting/src/main/java/org/apache/rocketmq/remoting/protocol/RemotingSerializable.java
#	srvutil/pom.xml
#	store/pom.xml
#	store/src/main/java/org/apache/rocketmq/store/CommitLog.java
#	store/src/main/java/org/apache/rocketmq/store/ConsumeQueue.java
#	store/src/main/java/org/apache/rocketmq/store/DefaultMessageStore.java
#	store/src/main/java/org/apache/rocketmq/store/MultiDispatch.java
#	store/src/main/java/org/apache/rocketmq/store/dledger/DLedgerCommitLog.java
#	store/src/main/java/org/apache/rocketmq/store/ha/HAConnection.java
#	store/src/main/java/org/apache/rocketmq/store/ha/HAService.java
#	store/src/main/java/org/apache/rocketmq/store/index/IndexFile.java
#	store/src/main/java/org/apache/rocketmq/store/logfile/DefaultMappedFile.java
#	store/src/main/java/org/apache/rocketmq/store/stats/BrokerStatsManager.java
#	store/src/test/java/org/apache/rocketmq/store/DefaultMessageStoreCleanFilesTest.java
#	store/src/test/java/org/apache/rocketmq/store/MultiDispatchTest.java
#	store/src/test/java/org/apache/rocketmq/store/dledger/DLedgerCommitlogTest.java
#	test/pom.xml
#	tools/pom.xml
#	tools/src/main/java/org/apache/rocketmq/tools/admin/DefaultMQAdminExt.java
#	tools/src/main/java/org/apache/rocketmq/tools/admin/DefaultMQAdminExtImpl.java
#	tools/src/main/java/org/apache/rocketmq/tools/admin/MQAdminExt.java
#	tools/src/main/java/org/apache/rocketmq/tools/command/MQAdminStartup.java
#	tools/src/main/java/org/apache/rocketmq/tools/command/topic/DeleteTopicSubCommand.java
2022-07-08 15:03:54 +08:00
hzh0425 99d77df54f [Summer of code] Fix the isuue of frequent disconnection of ha connection (#4399)
* fix bug

* throw exception in haWriter

* fix haconnection can't read msg.

* set channel buf = 0

* code review

* code review

* change client address to slave address

* Revert "change client address to slave address"

This reverts commit 198bcdb00e.
2022-06-02 11:07:19 +08:00
RongtongJin 6f3b372e83 Polish naming convention of controller 2022-06-01 14:59:24 +08:00
hzh0425 f905da411a [Summer of code] Let broker send heartbeat to controller (#4341)
* let broker send heartbeat to controller

* code remview

* code review

* fix bug

* add state in replicasmanager

* add brokerId when getReplicasInfo

* code review
2022-05-20 17:35:07 +08:00
hzh0425 ad8851bef9 [Summer of Code] Support switch role for broker (#4272)
* feature:
1.add replicasManager and controllerProxy

* feature:
1.add brokerHaAddress in controller.

* feature:
1.add replicasManager

* feature:
1.add brokerController to replicasManager.
2.change brokerController when change role.

* feature: add api message empty constructor

* feature: move set from header to remotingRequest body

* feature: modify autoSwitchHaClient's rpc protocol, add slaveId, slaveAddress.

* feature: review code

* feature: review code

* add some debug info

* feature: let ha service get masterHaAdress after register to name-srv

* feature: review code xxxx

* feature: let controller return err remark

* style: review

* style: review code

* feature: add more integrationTest

* style: review code

* style: review code

* fix: port already bind
2022-05-16 17:32:48 +08:00
rongtong a4cccea9db [ISSUE#4233] Move the capability of slaveActingMaster from container module to broker module 2022-05-06 10:21:14 +08:00
cserwen 7a5fff4f10 [ISSUE #4192] Fix log split not work for dLedger in container (#4193) 2022-04-23 15:00:52 +08:00
cserwen bb9d6e62b9 [ISSUE #3798] Support container in DLedger. (#4100)
* support container in DLedger Model

* use BrokerIdentity to replace BrokerConfig

* add logic to support remove dLedger Broker

* add unit test for add&remove dLedger broker

* modify mqadmin to adapt to dLedger
2022-04-09 16:24:16 +08:00
RongtongJin c8f67716e9 Fix bug that container UT can not pass 2022-03-18 21:50:14 +08:00
cserwen d99bf55205 [ISSUE #3992] code optimizations about BrokerContainerStartup.class 2022-03-17 20:44:39 +08:00
rongtong 27ab1dfdcd feature(container&remoting):[RIP-31][PART-A]Support RocketMQ BrokerContainer (#3976) 2022-03-14 14:50:28 +08:00