Commit Graph
8012 Commits
Author SHA1 Message Date
mxsm eb804014f1 [ISSUE #6466] Add ForbiddenType when Broker process PullMessage return no permission 2023-03-26 11:00:57 +08:00
mxsm 8ddf2fdd42 [ISSUE #6469]Translation persistent_unique_broker_id.md (CN->EN) (#6470) 2023-03-25 17:13:13 +08:00
caigy 8aa7bc08f7 [ISSUE #6400] Remove unnecessary config BrokerConfig.maxDelayTime 2023-03-24 14:48:17 +08:00
Zhouxiang Zhan 8c4568569c Add rpc validatation for gRPC in PlainAccessResource (#6460)
* including NotifyClientTerminationRequest, QueryRouteRequest, QueryAssignmentRequest, ChangeInvisibleDurationRequest
2023-03-24 10:16:52 +08:00
Ji JuntaoandLi Zhanhui 1818c2d507 [ISSUE #4890] BugFix: fix binary search consume offset by time (#6429)
* BugFix: fix binary search consume offset by time

* polish codes.

* modify the test case: when timestamp is skewing, only find lower bound.

* modify the test case: when timestamp is skewing, only find lower bound.

* modify the test case: when timestamp is skewing, only find lower bound.

---------

Co-authored-by: Li Zhanhui <shutian.lzh@alibaba-inc.com>
2023-03-24 10:15:41 +08:00
hiyoandLi Zhanhui 0faa0a2c7d [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromName… (#6452)
* [ISSUE #6414] polish MQClientAPIImpl.getDefaultTopicRouteInfoFromNameServer parameters

* Fix to make Bazel CI pass

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Fix typo

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2023-03-23 20:30:21 +08:00
SSpirits a7a86382f0 [ISSUE #6454] Fix unsafe shutdown process in tiered storage (#6455)
* fix the risk of a potential JVM crash in tiered storage test

* fix unit test

* fix checkstyle
2023-03-23 19:20:43 +08:00
Lobo Xu 91ccfeb2f4 When the proxy starts, the log displays the configuration details (#6453) 2023-03-23 18:57:53 +08:00
guyinyouandguyinyou 9b97eaf5ba [ISSUE #6424] Make topicConfig updating atomically
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
2023-03-23 14:18:19 +08:00
Cyandcyu fe0a0a0789 [ISSUE #6440] Optimize the code of consumer thread name,and support tag the name of scheduledExecutor thread. (#6441)
Co-authored-by: cyu <dingchengyu@hydee.cn>
2023-03-23 14:16:24 +08:00
lk 59c82d9976 [ISSUE #6449] Fix NPE in MultiProtocolRemotingServer (#6450) 2023-03-23 11:41:23 +08:00
Lobo Xu b41d1ddf35 [ISSUE #6373] Optimized log printing and fixed null pointer exceptions (#6375) 2023-03-23 10:44:46 +08:00
lk e3b5f07ae8 [ISSUE #6438] Optimizing the memory usage of MultiProtocolRemotingServer (#6439) 2023-03-22 19:09:49 +08:00
guyinyouandguyinyou c17baf1e33 [ISSUE #6386] Some improvements for compactionTopic (#6387)
* 1、Graceful shutdown needs to wait for the compactionTopic to build the index
2、Exception handling that may occur when adding pullMessageFromMaster
3、Update usage docs

* fix doc

---------

Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
2023-03-22 11:23:13 +08:00
TheR1sing3un 1e2a301266 [ISSUE #6382] Periodically check for inactive masters (#6383)
* feat(controller): concurrent protect ReplicasInfoManager#replicaInfoTable and ReplicasInfoManager#syncStateSetInfoTable

1. concurrent protect ReplicasInfoManager#replicaInfoTable and
ReplicasInfoManager#syncStateSetInfoTable

* docs(controller): make statemachine thread-safe and support timed checking inactive master in each broker-set

1. make statemachine thread-safe
2. support timed checking inactive
master in each broker-set

* fix(controller): Add some logic when visit the BrokerReplicaInfo to avoid NPE

1. Add some logic when visit the BrokerReplicaInfo to avoid NPE

* test(controller): polish some test logic

1. polish some test logic

* fix(controller): Revise back the ControllerConfig#controllerStorePath to avoid the Incompatibility problems

1. Revise back the ControllerConfig#controllerStorePath to avoid the
Incompatibility problems
2023-03-21 13:59:53 +08:00
Ruantihong c5fec3af41 [ISSUE #6402]opt transaction message check (#6401)
* If you specify a custom first check time CheckImmunityTimeInSeconds,And the commit/rollback request whose validity period exceeds CheckImmunityTimeInSeconds and is not checked back will be processed and failed

* remove useless code

* update transactionCheckInterval default to be 30s
2023-03-21 13:40:34 +08:00
Ji Juntao cafc9ac3de [ISSUE #6421] Fix the encode bug. 2023-03-21 13:38:00 +08:00
fujian-zfj f2614f62c8 [ISSUE #6419] DLedger new version to fix problem in issue 282 (#6418)
* typo int readme[ecosystem]

* dledger new version
2023-03-21 10:20:38 +08:00
TheR1sing3un d75ab111f3 [ISSUE #6406] Add more visual comments on IndexFile & IndexHeader & ConsumeQueue
1. add more visual comments
2023-03-21 08:42:40 +08:00
deepsola 38ce7c891d [ISSUE #6408] Due to network issues, use new ASK cluster in VIRGINA to run e2e test (#6409)
* Match apache actions policy, use apache/rocketmq-test-tool in workflow

* use new env ASK_CONFIG_VIRGINA to run e2e test
2023-03-20 21:40:11 +08:00
Ji Juntao f1e02e8947 [ISSUE #6392] GetSyncStateSet prints replica's alive status (#6393)
* print replica's alive status

* refactor

* rename getIsAlive-getAlive and setIsAlive-setAlive.
2023-03-20 13:53:07 +08:00
mxsm 68362151a2 [ISSUE #6396] Fix DefaultMQPushConsumer javadoc typo (#6397) 2023-03-20 10:59:15 +08:00
Oliver 3f8cf890ff [ISSUE #6026] Fix the problem that the custom JAVA_HOME environment variable does not take effect (#6167) 2023-03-20 10:54:00 +08:00
rongtong c05a0b222c [ISSUE #6377] Polish the code when broker change to master (#6378)
* Polish the code when broker change to master

* Pass the check style

* Polish the log
2023-03-20 09:52:53 +08:00
Ji Juntao 7d67484456 [ISSUE #6390] Add break to the exception of WHEEL_TIMER_NOT_ENABLE. (#6394) 2023-03-19 14:56:52 +08:00
yuz10 3613821c6a [ISSUE #6365] fix no log in benchmark (#6366)
* fix no log in benchmark

* remove logging debug
2023-03-18 19:52:05 +08:00
fuyou001 7dbcdc8f96 [ISSUE #6372] new scheduledExecutor clean consume queue (#6376) 2023-03-17 16:48:50 +08:00
Ji Juntao 5ac91199f2 [ISSUE #6380] Optimize switch cases in BrokerOuterAPI. (#6381)
* [ISSUE #6380] Optimize switch cases in BrokerOuterAPI.

* optimize the logic.
2023-03-17 15:56:36 +08:00
fujian-zfj 4e0a723d22 [ISSUE #6344] queueOffsets in topicQueueTable rollback when master changes to master in ha mode (#6345)
* typo int readme[ecosystem]

* master to master, no need to recover topicQueueTable

* revert

* optimize

* fix bug found by test

* remove unused log
2023-03-17 09:26:38 +08:00
Lobo Xuandloboxu 10d17cfaee [ISSUE #6287] Fixed two redundant judgments (#6288)
Co-authored-by: loboxu <loboxu@tencent.com>
2023-03-16 21:25:20 +08:00
loboxu 877f146f56 ReceiptHandleProcessor message renewal strategy optimization 2023-03-16 19:55:04 +08:00
loboxu feb1f3077a ReceiptHandleProcessor message renewal strategy optimization 2023-03-16 19:55:04 +08:00
loboxu 1e3e7638f3 ReceiptHandleProcessor message renewal strategy optimization #6232 2023-03-16 19:55:04 +08:00
loboxu fce64608b1 ReceiptHandleProcessor message renewal strategy optimization #6232 2023-03-16 19:55:04 +08:00
loboxu 06a87e6504 ReceiptHandleProcessor message renewal strategy optimization #6232 2023-03-16 19:55:04 +08:00
loboxu 667ebbcc14 ReceiptHandleProcessor message renewal strategy optimization #6232 2023-03-16 19:55:04 +08:00
TheR1sing3un 6fd1bb9a28 [ISSUE #6358] Add chinese docs about persistent-unique-broker-id (#6359)
* docs(controller): add chinese docs about persistent-unique-broker-id

1. add chinese docs about persistent-unique-broker-id

* docs(controller): optimize style in docs: persistent-unique-broker-id.md

1. optimize style in docs: persistent-unique-broker-id.md

* docs(controller): remove test in docs: persistent-unique-broker-id.md

1. remove test in docs: persistent-unique-broker-id.md
2023-03-16 15:17:21 +08:00
Ji Juntao 63a014b810 [ISSUE#6342] Local SyncStatSet sync to remote value when changeToMaster (#6352)
* fix ISSUE#6342

* refactor

* correct the syncStateSet in elect process.

* move syncStateSet into request/response's body.

* optimize the broker electing switch's branch.
2023-03-16 11:48:04 +08:00
Lei Zhiyuan 3db8d039d1 [ISSUE #6347] fix: use mutable list to avoid start fail when enable tiered store 2023-03-16 11:01:34 +08:00
redlsz 4a4626df63 [ISSUE #6343] fix consumeQueueExtDir not deleted when deleting topic (#6351) 2023-03-15 16:08:20 +08:00
hardyfish 94db42ade7 [ISSUE #6292] fix typos (#6293)
* fix typos

* fix typos

* fix typos
2023-03-15 15:41:01 +08:00
TheR1sing3un 52c4c0cdf6 [ISSUE #6346] Support asynchronously notify brokers when their roles has been changed (#6348)
* feat(controller): support asynchronous notify brokers when roles changed

1. support asynchronous notify brokers when roles changed

* refactor(controller): move creating NotifyService instance logic to ControllerManager's constructor method

1. move creating NotifyService instance logic to ControllerManager's
constructor method
2023-03-15 13:50:06 +08:00
Liu Ruoyu 616885ce17 Added jul to slf4j bridge
Now, broker metrics and proxy metric could output to "rocketmqlogs" folder. Their names are "broker_metric.log" and "proxy_metric.log", respectively.
2023-03-15 10:19:41 +08:00
Liu Ruoyu 57dd002fab Update WORKSPACE 2023-03-15 10:19:41 +08:00
Liu Ruoyu 6a42102bc3 fix bazel test 2023-03-15 10:19:41 +08:00
Liu Ruoyu f34743217c Fix parameter in metrics exporter 2023-03-15 10:19:41 +08:00
Liu Ruoyu 5fd07d8aa7 Add logging exporter for metrics 2023-03-15 10:19:41 +08:00
Lobo Xuandloboxu 7485d3cbef [ISSUE #6313] com.google.guava version upgraded
Co-authored-by: loboxu <loboxu@tencent.com>
2023-03-15 09:40:11 +08:00
Humkum 1c98a2316f [ISSUE #6215]make benchmark cover compress msg situation (#6216) 2023-03-14 21:07:51 +08:00
MisakiandMisaki 95299c05e9 [ISSUE #6268] fix rocketmq-proxy does not work properly in k8s nodePort mode (#6262)
* fix rocketmq-proxy does not work properly in k8s nodePort mode

* Add configuration to support k8s nodePort mode

* rename forceUseEndpointPort to useEndpointPortFromRequest

---------

Co-authored-by: Misaki <Wsywsy22@2914883754@qq.com>
2023-03-14 17:21:05 +08:00