370 Commits

Author SHA1 Message Date
Zhanhui Li 322e00a475 [ISSUE #5617] Fix Bazel warning & dependency (#5618)
* Fix Bazel indirect deps warning

* Remove unused deps
2022-12-01 15:53:30 +08:00
SSpirits d3de48c806 [ISSUE #5605]Introduce tag estimation for lag calculation (#5606)
* Introduce tag estimation for lag calculation

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>

* fixed according to review comments

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-30 14:52:59 +08:00
SSpirits 08dbe7ede9 fix flaky test (#5591) 2022-11-25 10:06:31 +08:00
Aaron Ai 4469fb51dd Update group id of rocketmq logging (#5564) 2022-11-22 11:31:21 +08:00
rongtong ee37e3a55f [ISSUE #5471] Fix AutoSwitchRoleIntegrationTest still experience random failures (#5475)
* Make AutoSwitchRoleIntegrationTest more stable

* Pass the checkstyle

* Pass the checkstyle

* Fix compatibility issues

* Simple optimization

* Remove useless import

* Pass the check style

* Pass the check style

* Modify DEFAULT_FILE_SIZE

* Modify DEFAULT_FILE_SIZE

* test

* Remove useless import

* Add more output to debug

* Use the new directory every time when start a broker

* Use the new directory every time when start a broker

* Remove console output

* Remove console output
2022-11-22 09:34:30 +08:00
Aaron Ai a68078fef8 [ISSUE #5484] Replace logging module with the shaded logback (#5540)
* Replace logging module with the shaded logback

* Add license header

* Fix bazel compile issue
2022-11-21 16:30:15 +08:00
yukon 506b563f55 Revert "[ISSUE #5484] Replace Logging Module with Shaded Logback (#5524)" (#5537)
This reverts commit 809ff6b3e0.
2022-11-17 20:04:17 +08:00
Aaron Ai 809ff6b3e0 [ISSUE #5484] Replace Logging Module with Shaded Logback (#5524)
* Remove ClientLogger

* WIP

* WIP

* Rename logger to log

* Make it compile

* WIP

* Fix bazel to use shaded slf4j

* Fix DeleteExpiredCommitLogSubCommandTest

* Fix pom.xml duplication

* Fix maven deps

* Add test logback configuration file

* Fix unit test output

* Fix logback configuration file

* All logging are made on top of slf4j

* Fix test log configuration file name

* Fix test log configuration file name for test module

* All logging are shaded slf4j targeted

* DLedger has an explicit dependency on slf4j

* Fix DLedger

* Fix DLeader issue

* Move logback configuration files to each module

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-17 00:38:28 +08:00
SSpirits ec5d3236f6 invert dependency between remoting and common module (#5503)
* invert dependency between remoting and common module

* fix bazel

* Fix Bazel warning of indirect dependency

* remove duplicate class ServiceThread

* fix conflict

* revert delete class ServiceThread because of introduced by dledger

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-11 13:34:31 +08:00
lizhimins 2113c16ebc [RIP-48] Support reset offset in server-side for pop message (#5457)
* [RIP-48] Support reset offset in server-side for pop message

* [RIP-48] Support reset offset in server-side for pop message

* no need remove error log

Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
2022-11-07 13:55:03 +08:00
SSpirits 350e433acc implement broker stats metrics and request metrics (#5449)
* implement broker stats metrics and request metrics

* fix bazel

* PopBigMessageIT potentially needs more time

* Fix bazel deps warning

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-02 20:42:42 +08:00
lk 58c79c9f13 [ISSUE #5365] [RIP 51] Add notification mechanism for pop orderly (#5387)
* [ISSUE #5365] Add notification mechanism for pop orderly

* [ISSUE #5399] add guava dependency for the test of store in BUILD.bazel
2022-10-31 13:32:14 +08:00
lk d54f8cb1eb [ISSUE #5402] not to decompress the body of messages when get retry messages in PopReviveService (#5403) 2022-10-27 15:32:51 +08:00
lizhimins a7c1d49454 [ISSUE #5356] [RIP 48] Introduces the concept of ready and inflight messages (#5357)
* Introduces the concept of ready and inflight messages

* update consumer progress subcommand

* fix consumer pull offset is less than consumer offset

* remove unused import

Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
Co-authored-by: ShadowySpirits <admin@lv5.moe>
2022-10-26 15:41:41 +08:00
rongtong 0e3f8b4d72 Fix the issue that TransactionMessageIT can not pass (#5394) 2022-10-24 18:45:05 +08:00
caigy 4af193e325 [ISSUE #5012] Support escaping transactional messages (#5062)
* support escaping transactional messages

* add integration test

* increase the number of messages and size integration test

* reorder condition and remove sysout

* add mock in unit test

* fix checkstyle

* ignore integration test by default

* use PutMessageResult.isOk() to check the result of escaping messages
2022-10-24 14:28:00 +08:00
lk 03ffc45a8b [ISSUE #5364] Support changeInvisibleTime for pop orderly (#5367) 2022-10-24 10:44:06 +08:00
mxsm 06a5496933 [ISSUE #5324]Replace deprecated class PosixParser with DefaultParser for CLI (#5325)
* [ISSUE #5324]Replace deprecated class PosixParser with DefaultParser for CLI

* fix bazel compile UpdateAccessConfigSubCommandTest testExecute failures

* Fixed bazel compile UpdateAccessConfigSubCommandTest testExecute failures
2022-10-19 22:43:06 +08:00
lizhimins d663bcf6aa [ISSUE #5292] [RIP-48] Support reset offset in server-side to improve the success rate (#5293)
* [RIP-48] Support reset offset in server side to improve the success rate

* [RIP-48] Support reset offset in server side to improve the success rate

* [RIP-48] Fix code style

* fix unit test

* no need put offset in reset command header

Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
2022-10-14 14:02:08 +08:00
Nowinkey 53e0847528 [ISSUE #5204] Enable checkstyle for test code (all module) (#5297)
* delete the checkstyle plugin for child modules

* [ISSUE #5204] Enable checkstyle for test code (all module)

* Exclude generated files

Co-authored-by: Zhanhui Li <lizhanhui@apache.org>
2022-10-14 10:58:48 +08:00
rongtong 12e29df6db Fix the issue that AutoSwitchRoleIntegrationTest is flaky (#5277) 2022-10-11 18:44:22 +08:00
Zhanhui Li 94d8e55012 Fix NPE in CI (#5273) 2022-10-11 17:27:51 +08:00
Nowinkey 3690049cb5 [ISSUE #5223] Enable checkstyle for test code (rocketmq-test) (#5224)
* style(test):Enable checkstyle for test code

* Sync bazel ignore list with renaming

Co-authored-by: Zhanhui Li <lizhanhui@apache.org>
2022-09-29 18:24:56 +08:00
hill ac82378aea [maven-release-plugin] prepare for next development iteration 2022-09-19 10:27:17 +08:00
hill f3e113cb1f [maven-release-plugin] prepare release rocketmq-all-5.0.0 2022-09-19 10:26:58 +08:00
lk e11dc27c49 [ISSUE #5069] polish the startup of proxy; can specify parameters on the command line of proxy (#5083)
undefined
2022-09-19 10:10:18 +08:00
windWheel ee1e542e11 [ISSUE#4949] fix Address already in use (#5000)
* [flaky-test] fix Address already in use'

* Re-apply for a port when the port is occupied
2022-09-06 19:54:34 +08:00
Zhanhui Li 35ac588fb5 [ISSUE #4979] Fix flaky integration test NormalMessageSendAndRecvIT (#4980)
* Fix netty warning; Fix flaky integration test NormalMessageSendAndRecvIT; Fix naming typo

* Change log level

* Use awaitability to make everyone happy

* Do not submit tasks when executor has been shut down
2022-09-05 14:27:01 +08:00
Zhanhui Li 86e435419d [ISSUE: 4974]Fix name server client config when OS picks up available port (#4975)
* Fix name server client config when OS picks up available port

* Fix check style issue
2022-09-02 15:20:23 +08:00
Aaron Ai 4661e58ebe [ISSUE #4934] Checking for violations as part of build (#4935)
* Checking for violations as part of build

* Extend await time for FileWatchServiceTest#watchTwoFiles_ModifyOne
2022-08-31 10:55:04 +08:00
Aaron Ai f23fdbe016 Replace findbugs by spotbugs (#4931) 2022-08-30 17:45:56 +08:00
Zhanhui Li aae7b37d04 [ISSUE 4915] Identify flaky tests (#4919)
* Rule out tests that are flaky. Aka they failed to pass 64 sequential  and concurrent runs

* Change default log root directory for tests

* Follow test encyclopedia

* Fix test cases, allowing OS pick up available port to listen to

* Add sha256

* Use pull_request
2022-08-29 19:52:53 +08:00
Zhanhui Li ee1c9b31ce Refine test size of test module (#4886) 2022-08-25 13:05:03 +08:00
Zhanhui Li 3da7ea9c1b [Infra Improvement] Build And Run Unit Tests in Parallel (#4878)
* Support build with Bazel (#4865)

* Support build with Bazel, fixing tests to make them capable of running in concurrency and hermetic.

* Make test cases capable of running in parallel. (#4874)
2022-08-24 20:53:30 +08:00
caigy 10d291846e [ISSUE #4832] Remove innerProducer and innerConsumer in EscapeBridge (#4834)
* remove innerProducer and innerConsumer in Escape
 #4832

* format code to pass code-style check

* Move topic route management logic to TopicRouteInfoManager

* Use ThreadPoolExecutor instead of creating a new ForkJoinPool

* remove retry logic

* remove unnecessary name server list

* remove unnecessary invokeId

* remove AssignmentManager and make maintenance of topic subscribe data lazy-initialized

* simply code

* remove unnecessary code
2022-08-24 15:18:51 +08:00
RongtongJin bbbb96e129 Revert "Support build with Bazel (#4865)"
This reverts commit ec8a93d2f7.
2022-08-23 14:29:46 +08:00
Zhanhui Li ec8a93d2f7 Support build with Bazel (#4865)
* Support build with Bazel, fixing tests to make them capable of running in concurrency and hermetic.
2022-08-23 13:11:53 +08:00
caigy e3c2111feb [ISSUE #4821] Add some integration tests for POP consumption in slave-acting-master mode (#4822)
* fix #4821

* add license header and ignore executing integration tests in automatic flow

* fix unit test

* fix unit test
2022-08-16 21:39:41 +08:00
Guocheng Tang 79d89f74d5 fix typo (#4802) 2022-08-10 09:25:58 +08:00
Aaron Ai 61b14c3f4e [ISSUE #4785] Enable misspell check GitHub Action (#4786)
* Enable misspell check GitHub Action

* Fix typo
2022-08-08 09:28:41 +08:00
rongtong c292574cd5 [ISSUE #4758] Timer Message adapts to slaveActingMaster mode (#4757)
* Timer Message adapts to slaveActingMaster mode

* Add asf-header to TimerCheckPointTest
2022-08-04 10:11:02 +08:00
mxsm c6b3a66ecf [ISSUE #4706] fix console printed log format is incorrect (#4716) 2022-08-03 09:19:03 +08:00
mxsm 7cc5cf1fae [ISSUE #4748] Add attribute enableControllerInNamesrv to NamesrvConfig (#4760) 2022-08-02 08:50:56 +08:00
mxsm b875b3309a [ISSUE #4709] fix method is on the same line as @Override annotation (#4717)
Co-authored-by: Aaron Ai <yangkun.ayk@gmail.com>
2022-08-01 20:42:34 +08:00
kaiyi.lk 6a95661291 fix proxy IT 2022-08-01 14:11:14 +08:00
kaiyi.lk 2ac15dd8b3 change poll time calculate method; init PopMessageResultFilter by maxAttempts directly 2022-08-01 14:11:14 +08:00
dongeforever 14f83546b0 Ignore the schema test currently 2022-07-25 10:46:04 +08:00
dongeforever 5780332846 Merge remote-tracking branch 'apache/develop' into schema_test_merge
# Conflicts:
#	pom.xml
#	test/pom.xml
2022-07-25 10:41:49 +08:00
RongtongJin dd09f2b782 Merge remote-tracking branch 'apache/develop' into 5.0.0-beta-dledger-controller
# Conflicts:
#	distribution/bin/mqshutdown
#	pom.xml
2022-07-20 10:53:39 +08:00
zhouxiang f51f9f657f Merge branch 'develop' into feature/grpc-develop-v2 2022-07-19 21:35:20 +08:00