opensource/rocketmq
3
0
Fork 0
mirror of https://github.com/apache/rocketmq.git synced 2026-09-19 10:54:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,664 Commits 73 Branches 40 Tags
87b97f271c96bdbb320b1e127cbeaaa4e83c4c2a
Commit Graph
644 Commits
Author SHA1 Message Date
dingshuangxi888 87b97f271c [ISSUE #8917]Topic route return none permission message queues for gRPC client (#8919) 
* When the queue lacks permission, return one queue to allow the client to upload a heartbeat for gRPC Topic route interface.
 2024-11-14 19:24:19 +08:00
LetLetMe 0b24768500 [ISSUE #8822] Double write cq, reduce unnecessary switches (#8823) 
* Reduce unnecessary switches
 2024-10-29 19:09:35 +08:00
Zhanhui Li c8938e0c6c [ISSUE #8829] feat: provide ConfigManagerV2 to make best uses of RocksDB (#8856) 
* feat: provide ConfigManagerV2 to make best uses of RocksDB

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: release RocksDB objects using try-with-resource

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
 2024-10-28 10:00:33 +08:00
Zhanhui Li b86059c7c1 Support LMQ dispatch in case if Consume Queue Store is RocksDB-based (#8842) 
* feat: support LMQ dispatch

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: introduce group-commit for batch insertion of RocksDB KV pairs

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: propagate store error to broker module

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: fix all Bazel warning and errors

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* fix: remove unnecessary batch-ops when writing RocksDB using atomic flush

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: find a writable directory for RocksDB logs

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: clean up ConfigHelperTest

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: truncate consume queues in case commit log records are truncated

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: truncate LMQ max offsets

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: correct truncate boundary of consume queues

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: correct MessageExt encoding

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* chore: remove unused import

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>
 2024-10-23 09:56:37 +08:00
mawen12 c033c3e85f [ISSUE #8848] Fix log typo 2024-10-23 08:29:35 +08:00
Zhanhui Li 49e23e1e0b fix: atomic flush incorrect use and clean up code (#8830) 
Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
 2024-10-18 14:30:38 +08:00
rongtong 4f5f705f16 [ISSUE #8780] Implement asynchronous storage of ack/ck messages in pop consume to enhance performance (#8727) 
* Pop consume asynchronization

* Pass UTs and ITs

* Pass the checkstyle

* Fix LocalGrpcIT can not pass

* Fix the UT can not pass

* Simplify duplicate methods in EscapeBridge
 2024-10-16 13:39:27 +08:00
luozongle01 782da708d5 [ISSUE #8786] Fix doc typo (#8787) 2024-10-08 17:42:23 +08:00
lizhimins daf3d1a666 [maven-release-plugin] prepare for next development iteration (#8750) 2024-09-26 09:33:52 +08:00
lizhimins b122c8109d [maven-release-plugin] prepare release rocketmq-all-5.3.1 (#8749) 2024-09-25 23:24:56 +08:00
lizhimins df8757f09e [ISSUE #8731] Prepare to release Apache RocketMQ 5.3.1 (#8732) 2024-09-25 20:56:33 +08:00
LetLetMe 525f877f3b [ISSUE #8589] Support file format CQ and json format offset in-place upgrade to rocksdb management (#8600) 2024-09-23 19:24:15 +08:00
qianye 0d6c94be0e [ISSUE #8705] Make MQClientAPIFactory shutdown async (#8706) 2024-09-19 20:13:12 +08:00
Ji Juntao 9b53c06f07 [ISSUE #8657] Make retry topic pop probability configurable 2024-09-07 19:58:42 +08:00
qianye 5d43e7d111 [ISSUE #8609] Add the BrokerConfig updateNameServerAddrPeriod (#8626) 2024-09-04 17:14:45 +08:00
小陈 b9d9b3fcae [ISSUE #8607] Exclude loopback addresses when iterating over local network interfaces 2024-08-30 09:20:45 +08:00
LetLetMe 2a938fb1bc [ISSUE #8058] Support for upgrading metadata in json to rocksdb (#8571) 2024-08-23 11:18:03 +08:00
zekai-li aa788e8796 [ISSUE #8289] Fixed network bugs and merged networkutil code (#8290) 
* [ISSUE #8289] Fixed network bugs and merged networkutil code
Fix the following three as
1，TraceBean： private static final String LOCAL_ADDRESS = UtilAll.ipToIPv4Str(UtilAll.getIP()); getIP mayby ipv6
2，NetworkUtil：if (ip.startsWith("127.0") || ip.startsWith("192.168") || ip.startsWith("0."))；Check whether Intranet errors exist

* [ISSUE #8289] Fixed network bugs and merged networkutil code
Fix the following three as
1，TraceBean： private static final String LOCAL_ADDRESS = UtilAll.ipToIPv4Str(UtilAll.getIP()); getIP mayby ipv6
2，NetworkUtil：if (ip.startsWith("127.0") || ip.startsWith("192.168") || ip.startsWith("0."))；Check whether Intranet errors exist
 2024-08-16 00:33:35 +08:00
imzs 524ca4e862 [ISSUE #8460] Improve the pop revive process when reading biz messages from a remote broker - part2 (#8494) 2024-08-14 13:48:44 +08:00
yx9o 606cefeb31 [ISSUE #8514] Fix bazel-compile (ubuntu-latest) ci run failure (#8515) 
* [ISSUE #8514] Fix bazel-compile (ubuntu-latest) ci run failure

* Update

* Update
 2024-08-10 21:07:36 +08:00
我是管小亮_V0x3f 8167608334 [ISSUE #8503] Add test cases for org.apache.rocketmq.common.chain/coldstr/compression/consumer (#8504) 
* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8417

Brief Description
add test case for AclConfig in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8476

Brief Description
add test case for org.apache.rocketmq.common.attribute in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8476

Brief Description
add test case for org.apache.rocketmq.common.attribute in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
Add test cases for org.apache.rocketmq.common.chain/coldstr/compression/consumer
Fixes apache#8503

Brief Description
add test case for org.apache.rocketmq.common.chain/coldstr/compression/consumer in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
Add test cases for org.apache.rocketmq.common.chain/coldstr/compression/consumer
Fixes #8503

Brief Description
add test case for org.apache.rocketmq.common.chain/coldstr/compression/consumer in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
Add test cases for org.apache.rocketmq.common.chain/coldstr/compression/consumer
Fixes #8503

Brief Description
add test case for org.apache.rocketmq.common.chain/coldstr/compression/consumer in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.
 2024-08-08 10:47:14 +08:00
我是管小亮_V0x3f d94d0751a9 [ISSUE #8476] Add test cases for org.apache.rocketmq.common.attribute (#8477) 
* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8417

Brief Description
add test case for AclConfig in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8476

Brief Description
add test case for org.apache.rocketmq.common.attribute in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8476

Brief Description
add test case for org.apache.rocketmq.common.attribute in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8476

Brief Description
add test case for org.apache.rocketmq.common.attribute in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.
 2024-08-05 09:53:55 +08:00
rongtong 3696be0632 [ISSUE #8463] Some statistical items should also be deleted to prevent memory leakage when a topic or group is deleted (#8464) 
* Some important statistical items should also be deleted to prevent memory leakage when a topic or group is deleted

* Add UTs
 2024-08-01 10:04:11 +08:00
rongtong 69334a708c [ISSUE #8432] Make autoDeleteUnusedStats default to true 2024-08-01 10:01:50 +08:00
我是管小亮_V0x3f 59c8609f43 [ISSUE #8434] Add test cases for org.apache.rocketmq.common.action (#8435) 
* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8417

Brief Description
add test case for AclConfig in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* [ISSUE apache#8434] Add more test coverage for Add test cases for org.apache.rocketmq.common.action
 2024-07-25 19:03:14 +08:00
我是管小亮_V0x3f 0e56d8761c [ISSUE #8417] Add some test cases for org.apache.rocketmq.common.AclConfig (#8418) 
* Which Issue(s) This PR Fixes
add test case for AclConfig in commom module
Fixes #8417

Brief Description
add test case for AclConfig in commom module by using tongyi tools.

How Did You Test This Change?
run test case successfull.

* Which Issue(s) This PR Fixes
[Enhancement] Add test cases for org.apache.rocketmq.common.AclConfig #8417

Fixes #8417

Brief Description
add some test cases for org.apache.rocketmq.common.AclConfig.

How Did You Test This Change?
run test case successfull.
 2024-07-23 10:26:41 +08:00
yueran 6ecdc48223 [ISSUE #8413] Add some test cases for commom module 2024-07-22 11:14:35 +08:00
lizhimins 5dc0c6a8b5 [maven-release-plugin] prepare for next development iteration (#8382) 2024-07-09 01:30:43 +08:00
lizhimins 7ee50ec32e [maven-release-plugin] prepare release rocketmq-all-5.3.0 (#8379) 2024-07-08 23:15:33 +08:00
lizhimins 2bc0014c4b [ISSUE #8377] Prepare to release Apache RocketMQ 5.3.0 (#8378) 2024-07-08 21:09:20 +08:00
vateandsupervate 77d6633e62 [ISSUE #8298] Optimize some code format or style (#8299) 
Co-authored-by: supervate <vate@MacBook-Air-4.local>
 2024-07-04 18:36:55 +08:00
rongtong 3aa5d1936f Adjust the default value of ackMessageThreadPoolNums to 16 to prevent performance bottlenecks during high traffic. (#8337) 2024-07-02 17:08:54 +08:00
zzl b330130932 [ISSUE #8291] format proxy watermark output (#8292) 2024-06-24 15:55:03 +08:00
YASH PATEL 568950bbc8 [ISSUE #7466] Added fast failure in adminBrokerThreadPoolQueue (#7466) (#7798) 2024-06-17 14:59:17 +08:00
mxsm 38c56cd84b [ISSUE #8293] Remove the redundant code from the MessageDecoder#encodeMessage method (#8294) 2024-06-13 15:31:16 +08:00
yuz10andyuzhou 1b42515093 [ISSUE #8129] Support topic reserved time in tiered storage (#8130) 
Co-authored-by: yuzhou <yuzhou4@huawei.com>
 2024-05-22 14:09:00 +08:00
mxsm 94bb64f731 [ISSUE #8162]Optimize the logging printout for the ConfigManager#loadBak method (#8163) 2024-05-21 08:32:20 +08:00
Liu Shengzhong d05ff5ef68 [ISSUE #8098] Fix parsing delay message type from property 2024-05-07 10:44:26 +08:00
cnScarb a15088cbd3 [ISSUE #8096] fix log placeholder 2024-05-07 09:49:43 +08:00
dingshuangxi888 f2dd5b06fe [ISSUE #7943] Add bazel config for auth module and fix bazel test (#7944) 2024-03-20 14:38:01 +08:00
dingshuangxi888 e1339ac8a0 [ISSUE #7560] [RIP-68] Support RocketMQ ACL 2.0 (#7725) 
[ISSUE #7560] [RIP-68] Support RocketMQ ACL 2.0 (#7725)
 2024-03-18 14:07:51 +08:00
ChineseTony ab9a40163c [ISSUE #7904] use string builder to concat string 2024-03-14 16:03:21 +08:00
rongtong f41160210a [maven-release-plugin] prepare for next development iteration (#7828) 2024-02-12 11:07:03 +08:00
rongtong 281a7b32f0 [maven-release-plugin] prepare release rocketmq-all-5.2.0 (#7827) 2024-02-11 17:53:50 +08:00
rongtong 5e61354fdc [ISSUE #7793] Prepare to release apache rocketmq 5.2.0 2024-02-08 10:48:13 +08:00
rongtong 6616600fa5 [ISSUE #7791] Polish the code for jraft controller 2024-02-02 12:33:22 +08:00
bazeliskyandZhanhui Li af1936d93a [ISSUE #7715] Update Bazel toolchain to make the CI work (#7714) 
* Update bazel toolchain

Signed-off-by: Bazelisky <bazelisk@hotmail.com>

* fix a bad test case as it violates requirement of ConcurrentHashMap#computeIfAbsent

Signed-off-by: Bazelisky <bazelisk@hotmail.com>

* Exclude flaky tests from test suite

Signed-off-by: bazelisky <155456828+bazelisky@users.noreply.github.com>

* fix: format issue

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* fix: Remove unused import

* fix deps issue

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

* Expose data property of java_test, allowing to specify run_file

Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>

---------

Signed-off-by: Bazelisky <bazelisk@hotmail.com>
Signed-off-by: bazelisky <155456828+bazelisky@users.noreply.github.com>
Signed-off-by: Zhanhui Li <lizhanhui@gmail.com>
Co-authored-by: Zhanhui Li <lizhanhui@gmail.com>
 2024-02-01 16:52:55 +08:00
YASH PATELandRongtongJin f70862e57b [ISSUE #5613] Change the broker default value configuration of 'useServerSideResetOffset' (#5613) (#7581) 
Co-authored-by: RongtongJin <jinrongtong16@mails.ucas.ac.cn>
 2024-01-31 03:35:03 +08:00
yulangzandleizhiyuan 8df53dfde8 [ISSUE #7300] jRaft-Controller Implemention (#7301) 
* jRaft-Controller Implemention

* fix bazel build

* reformat code

* remove fury dependence

* fix bazel build

* resolve conflict

* clear code

* Optimize code style

* Optimize code style

* Optimize code style

* revert style only change
fix code style
rollback an unexpected modification.

* Update Producer.java

* chore: move raft startup to start method

* chore: use jraftconfig to collect all configs about jraft

* fix: fix wrong store path because init use string constant

* fix: fix CONTROLLER_NOT_LEADER error in follower

* chore: seperate jraft and controller log

* chore: fix conflict with develop

* chore: add comment to clear the filter logic

* feat: triggerElectMaster will retry when failed

* feat: when controller all restart, we use a timestamp to trace the first heartbeat, avoid to elect again

* fix: implements Serializable to enable snapshot serialize

* fix: use for loop to simple the elect retry

* chore: update jraft version

* chore: opt import

---------

Co-authored-by: leizhiyuan <leizhiyuan@gmail.com>
 2024-01-29 20:45:20 +08:00
Ji Juntao 3d357bb3ed [ISSUE #7772] Ensuring broker protection capabilities when POP does not return ACK (#7773) 
* add stop pop situation.

* refactor the imports

* modify the threadhold into threshold.

* checkstyle
 2024-01-26 14:34:53 +08:00