Commit Graph

7592 Commits

Author SHA1 Message Date
Aaron Ai 809ff6b3e0 [ISSUE #5484] Replace Logging Module with Shaded Logback (#5524)
* Remove ClientLogger

* WIP

* WIP

* Rename logger to log

* Make it compile

* WIP

* Fix bazel to use shaded slf4j

* Fix DeleteExpiredCommitLogSubCommandTest

* Fix pom.xml duplication

* Fix maven deps

* Add test logback configuration file

* Fix unit test output

* Fix logback configuration file

* All logging are made on top of slf4j

* Fix test log configuration file name

* Fix test log configuration file name for test module

* All logging are shaded slf4j targeted

* DLedger has an explicit dependency on slf4j

* Fix DLedger

* Fix DLeader issue

* Move logback configuration files to each module

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-17 00:38:28 +08:00
Humkum 48fab975e4 Fix : the topic attribute will be replace by null (#5527) 2022-11-16 20:28:29 +08:00
SSpirits b39f687f11 implement metrics for default message store 2022-11-16 10:23:18 +08:00
mxsm 14cff19f15 [ISSUE #5511]Fix Proxy start up throw NullPointerException (#5514)
* [ISSUE #5511]Fix Proxy start up throw NullPointerException

* do not init exporter when disable

do not init exporter when disable

* remove unused import

remove unused import

Co-authored-by: lizhimins <707364882@qq.com>
2022-11-14 17:38:07 +08:00
Zhouxiang Zhan f55e6bace3 [ISSUE #5506] Add create topic in docs (#5522) 2022-11-14 17:11:39 +08:00
RapperCL 1116de4f93 [ISSUE #5294]fix ClassLoad path optimization (#5295)
* loadClass optimization

* loadClass optimization

* code optimization

* code optimization

* Restore the original method, add method, reduce the impact

Co-authored-by: dinglei <libya_003@163.com>
2022-11-14 11:51:12 +08:00
mxsm 1c7961e4e4 [ISSUE #5499]Remove BrokerHousekeepingService unused static attribute log (#5500)
LGTM
2022-11-13 21:38:05 +08:00
echooymxq 407d2738f2 [ISSUE #5512] Skip the unnecessary network interfaces. (#5513) 2022-11-13 18:02:32 +08:00
Zhanhui Li 48ed898071 Use Mockito to directly throw TimeoutException through set-up (#5510) 2022-11-13 17:45:49 +08:00
SSpirits ec5d3236f6 invert dependency between remoting and common module (#5503)
* invert dependency between remoting and common module

* fix bazel

* Fix Bazel warning of indirect dependency

* remove duplicate class ServiceThread

* fix conflict

* revert delete class ServiceThread because of introduced by dledger

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-11 13:34:31 +08:00
SSpirits a5b40fba10 add client connection and consume lag metrics (#5505) 2022-11-10 19:38:31 +08:00
Aaron Ai 630abced4e Remove unnecessary retries in sendMessageBack (#5501) 2022-11-10 19:36:54 +08:00
Aaron Ai c217d8bb80 [ISSUE #5481] Decrease the repeated consumption probability of expired message (#5483)
* Decrease the repeated consumption probability of expired message

* Polish code

* Make test method name consistent with that of main source file

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-09 20:02:20 +08:00
SSpirits 0ae1bd2af6 [ISSUE #5449] [RIP-46] implement remoting stats metrics (#5487)
* implement remoting metrics

* fix bazel

* add metrics view & fix unit test

* move remoting command process timer to NettyDecoder
2022-11-09 19:44:41 +08:00
mxsm 6ac321c1a0 [ISSUE #5482] Remove ClientRequestProcessor#getRouteInfoByTopic method invalid logic judgment (#5488) 2022-11-09 19:43:28 +08:00
zhangjidi2016 f4ff225649 [ISSUE #4487]Optimize the output of pressure results (#5282)
Co-authored-by: zhangjidi <zhangjidi@cmss.chinamobile.com>
2022-11-09 19:33:41 +08:00
gongzhongqiang 4b3eafe260 Fix error core-concept url. (#5253)
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2022-11-09 19:33:10 +08:00
SSpirits 0ffb32f478 fix name server startup tip typo (#5491) 2022-11-09 18:12:50 +08:00
Humkum 6033983158 fix : npe caused by get item by logic offset if logic offset out of time (#5494) 2022-11-09 18:12:09 +08:00
Aaron Ai cca25fc525 Declare dependencies' version in maven properties (#5489) 2022-11-09 12:18:15 +08:00
jasonjavaYY 0d44ea183e modify variable name whichItemWorst to randomItem to resolve ambiguity (#5436) 2022-11-07 15:22:31 +08:00
mxsm 08bcd80681 [ISSUE #5446]Modify ScheduleMessageService's log name RocketmqStore to RocketmqBroker (#5447)
* [ISSUE #5446]Modify ScheduleMessageService's log name RocketmqStore to RocketmqBroker

* Skip test case that is flaky on Windows

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-07 15:21:37 +08:00
lizhimins 2113c16ebc [RIP-48] Support reset offset in server-side for pop message (#5457)
* [RIP-48] Support reset offset in server-side for pop message

* [RIP-48] Support reset offset in server-side for pop message

* no need remove error log

Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
2022-11-07 13:55:03 +08:00
Humkum 9b2375dcf4 Add log info for push consumer when execute hook failed (#5468) 2022-11-07 11:59:55 +08:00
Dejan Varmedja e91a2fa746 [ISSUE #5430] Remove redundant null check (#5467)
* Remove redundant null check

* Skip test cases for Mac that is flaky on the platform

* Disable PopBufferMergeServiceTest#testBasic on Windows

* Use MockitoJUnitRunner.Silent for PopBufferMergeServiceTest

Co-authored-by: Zhanhui Li <lizhanhui@gmail.com>
2022-11-07 11:13:13 +08:00
Zhanhui Li 130fb0c504 Enable checks on Windows and MacOS (#5459) 2022-11-04 14:35:59 +08:00
echooymxq d7321fee50 Fix windows can't move file when mmapped. (#5434) 2022-11-03 18:01:49 +08:00
Zhanhui Li 61fa3b0c23 [ISSUE #5344] Fix Windows and Mac CI pipelines (#5345)
* Skip tests that are not compatible with Windows using org.junit.Assume

* Skip incompatible test case

* Ignore cases that is not compatible with Windows

* Skip a test case on Mac to make CI pass

* Skip test case on Windows if load() fails

* Try to grant more time to TlsTest to make Mac CI pass

* Grant longer potential duration for await
2022-11-03 11:15:55 +08:00
mxsm 3963c754ed [ISSUE #5453]Combine parseDelayLevel error log information (#5454) 2022-11-02 20:53:28 +08:00
SSpirits 350e433acc implement broker stats metrics and request metrics (#5449)
* implement broker stats metrics and request metrics

* fix bazel

* PopBigMessageIT potentially needs more time

* Fix bazel deps warning

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-11-02 20:42:42 +08:00
rongtong d45a34c0a5 Fix ServiceProvider report NPE misleading users when no resource file found (#5450) 2022-11-02 19:17:24 +08:00
rongtong dd95a5b9c8 Fix Label '@maven//:com_google_guava_guava' is duplicated in the 'deps' attribute of rule 'tests' to pass CI (#5451) 2022-11-02 17:42:12 +08:00
lk 58c79c9f13 [ISSUE #5365] [RIP 51] Add notification mechanism for pop orderly (#5387)
* [ISSUE #5365] Add notification mechanism for pop orderly

* [ISSUE #5399] add guava dependency for the test of store in BUILD.bazel
2022-10-31 13:32:14 +08:00
mxsm 527704d964 [ISSUE #5413] Modify AutoSwitchHAClient currentReceivedEpoch attribute long type to int 2022-10-31 10:46:53 +08:00
RapperCL 6af6fedd05 [ISSUE #5415] Fix duplicate records (#5416)
* fix duplicate records

* code update
2022-10-31 10:44:41 +08:00
mxsm 520721d527 [ISSUE #5426] Fix mqadmin updateTopic CLI result print format problem (#5427) 2022-10-31 10:34:17 +08:00
RapperCL dd4b666435 [ISSUE #5424] Fix null exception and array overflow bug exist in getHalfMsg method #5425 2022-10-31 10:27:54 +08:00
zhangjidi2016 86bc27eb24 [ISSUE #5310] Fix admin tool queryMessage signature check failed (#5319)
* [ISSUE #5310] Fix admin tool queryMessage signature check failed

* Compatible with versions less than 4.9.4

Co-authored-by: zhangjidi <zhangjidi@cmss.chinamobile.com>
2022-10-28 14:26:28 +08:00
SSpirits 4ba8aa238d [ISSUE #5354] [RIP-46] Implement proxy metrics framework (#5407)
* implement proxy metrics framework

* fix bazel dependency

* fix proxy startup test

* fix warning in bazel test

* minor improve
2022-10-27 17:23:31 +08:00
lk 83540fca6a [ISSUE #5408] can skip ack when cannot find matching ck for a long time (#5409) 2022-10-27 17:14:09 +08:00
Nowinkey 7a4fa6b96e [ISSUE #5307] Remove redundant if statements (#5314) 2022-10-27 16:35:41 +08:00
Ruantihong 5d0db77f0c [RIP-50]RocketMQ Transaction Message Improvement Of Batch OP Message (#5386) 2022-10-27 16:15:49 +08:00
echooymxq c108124078 [ISSUE #5331]Fix ConsumeQueueTest stable sleep cause NPE. (#5397)
* [ISSUE #5331]Fix ConsumeQueueTest stable sleep cause NPE.

* Use awaitability to achieve granular condition check

* Add a timeout duration for condition check

* Add a timeout duration for condition check

Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-10-27 16:13:28 +08:00
lk d54f8cb1eb [ISSUE #5402] not to decompress the body of messages when get retry messages in PopReviveService (#5403) 2022-10-27 15:32:51 +08:00
lizhimins a7c1d49454 [ISSUE #5356] [RIP 48] Introduces the concept of ready and inflight messages (#5357)
* Introduces the concept of ready and inflight messages

* update consumer progress subcommand

* fix consumer pull offset is less than consumer offset

* remove unused import

Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
Co-authored-by: ShadowySpirits <admin@lv5.moe>
2022-10-26 15:41:41 +08:00
lk 40013b32e8 [ISSUE #5390] not to print some useless log in PopReviveService (#5391) 2022-10-25 10:10:34 +08:00
rongtong 0e3f8b4d72 Fix the issue that TransactionMessageIT can not pass (#5394) 2022-10-24 18:45:05 +08:00
xiaoyifang a2d52ef159 [ISSUE #5373] output namesrv bindaddress when starting (#5369)
[ISSUE #5373] output namesrv bindaddress when starting (#5369)

Co-authored-by: xiaoyifang <xiaoyifang@foxmail.com>
2022-10-24 17:06:12 +08:00
Lq Wang 865d7043be [ISSUE #5381] Optimize merge_rocketmq_pr.py comments (#5389) 2022-10-24 16:28:19 +08:00
ltamber e38da5590f [ISSUE #3799]main compaction process (#5351)
* add compaction delete policy

* wrapper message ext encoder

* fix

* cleanup policy

* cleanup policy

* wrapper message ext encoder

* Revert "cleanup policy"

This reverts commit da76a4820b.

* cleanup policy

* topic compaction

* compaction recovery and user document

* use cleanup policy

* fix
2022-10-24 16:21:39 +08:00