Commit Graph

8988 Commits

Author SHA1 Message Date
lizhimins b5da00ad0f [ISSUE #9936] Release Apache RocketMQ 5.4.0 (#9937) rocketmq-all-5.4.0 2025-12-24 15:24:57 +08:00
imzs 4b187c6e11 [ISSUE #9945] Use UniqueKey as the TimerDelKey value when no namespace is appended (#9951) 2025-12-24 13:48:47 +08:00
gaoyf 541fdad0ff [ISSUE #9947] Fix TimerMessageStore.checkAndReviseMetrics throws BufferUnderflowException (#9948) 2025-12-24 11:27:59 +08:00
imzs 79e700312a [ISSUE #9945] Use UniqueKey as TimerDelKey by default 2025-12-24 10:00:01 +08:00
littleboy 5132258db9 Fix epoch truncate (#9942) 2025-12-24 09:31:42 +08:00
yx9o fef690c06d [ISSUE #9943] Remove redundant containsKey check in checkBrokerConfig (#9944) 2025-12-24 09:31:19 +08:00
yx9o 684e73311f [ISSUE #9938] Rename misnamed Messing classes to Messaging (#9939) 2025-12-23 10:50:58 +08:00
Drizzle fe5c17cb8b Optimized the function naming (#9935)
* add isWakeCommitWhenPutMessage  for AIO

* optimzie the Function name

Change-Id: Id91e3eb9c4488fb9804fb2c105082657e66c44c0

* optimized the function naming

Change-Id: Ifc482f91220ff328e5c5425a57a04ac627e8d469

---------

Co-authored-by: drizzle.zk <drizzle.zk@alibaba-inc.com>
2025-12-19 16:03:49 +08:00
rongtong 02412eba59 [ISSUE #9933] Fix the failure when RocksDBConfigToJsonCommand exports locally. (#9934)
Co-authored-by: RongtongJin <user@example.com>
2025-12-19 10:03:30 +08:00
imzs 0792474479 [ISSUE #9928] Add Priority IT for GRPC protocol 2025-12-19 09:39:16 +08:00
yx9o c1ccc3ce00 [ISSUE #9914] Simplify isolation logic when updating fault item in sendKernelImpl (#9915) 2025-12-18 20:48:08 +08:00
lizhimins 6fa05ff6f9 [ISSUE #9921] Limit the concurrency of Pop revive (#9922) 2025-12-18 20:42:52 +08:00
yx9o 8c7bf5225a [ISSUE #9902] Remove unnecessary String.format (#9903) 2025-12-18 20:00:21 +08:00
imzs bdae09ddf2 [RIP-80] #9928 Implementation of Priority Message (#9929)
* #9928 Implementation of Priority Message

* switch to fastjson2

Change-Id: I3620b00b79a77a93a7cf0fdfac857fb495638ca6

* fix bazel CI, upgrade rocketmq-proto to 2.1.1

Change-Id: Ia66cc7b14b89dc319044ced5ba349315e487c849

* Fix bazel CI

* fix CI, temporarily disable popKv in OffsetResetForPopIT

Change-Id: I0b406cf0ece5067de430c4404aaa1f2dd46edcba

---------

Co-authored-by: RongtongJin <user@example.com>
2025-12-18 10:18:25 +08:00
yuz10 9f9cab88ba [ISSUE #9396] replace fastjson with fastjson2 (#9927)
* remove fastjson dependency

* remove fastjson

* revert

* revert
2025-12-16 19:11:01 +08:00
littleboy 71659e35f2 [ISSUE #8903] fix dledger mode expired message can not delete on jdk9+ (#9851) 2025-12-15 15:09:01 +08:00
yx9o beee84fa44 [ISSUE #9868] Fix getBrokerEpoch no response issue for empty parameters (#9869) 2025-12-12 16:26:48 +08:00
SHI 15796e73d3 [ISSUE #9912] Fix consumer offset timestamp displayed incorrect in tiered store (#9913)
Co-authored-by: shixiaoxiao <shixiaoxiao@bytedance.com>
2025-12-12 16:10:09 +08:00
qianye 6f5b551b88 [ISSUE #9918] Fix the message may be renewed once more if the gRPC push consumer is unexpectedly disconnected (#9919)
Change-Id: I00424612c5ee9dd30e5c155dab17262051e5f097
2025-12-12 16:08:46 +08:00
Drizzle 7a08b4cb68 [RIP-82] Implement Timer message, transaction message, and index based on RocksDB (#9787)
* add isWakeCommitWhenPutMessage  for AIO

* Implemented Timer message, Transaction Message, Index based on rocksdb

* add timeline roll interval can be config

* optimize the code

* optimize the code

* add sone logic for recover commitlog

* optimize the code

* update

* update

* optimize the code

* update

* update

* optimize the code

* optimize the code

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

Change-Id: I700798ef625187ac32c16c8ea5aae5f2debfdddf

* update

Change-Id: I1d2dfa24317d2ad7c0ca41d90cd2b3c1ba260b0b

* update

Change-Id: I974e30eb909722ea2a17a14e505759bf20f4f860

* update

Change-Id: Ica01fbd08a2d60e9a0f4ab54b41ae4768cc4fa5d

* update

Change-Id: I764ce6cea3159b025bf1e6e65b60e20514cecb4f

* update

Change-Id: I0cc735896e1266934293ec06cb4f07746a1894a1

* update

Change-Id: I6538b6a60631c62e162bf511ae20185a07b72508

* update

Change-Id: I03f83b9e8199f3595ca28471df4a2e94671fbaae

* update

Change-Id: I5b19b671fa0b40cd2aba63f1d0eb654b92775cb4

* update the code

Change-Id: I22788d112b7f214310719e2d3ebad839ef818e67

* update

Change-Id: I7da89fe635b58ac5026095a8e484fa46f68521e7

* update the code

Change-Id: I5eade6c31803b8cf05c1a4bb83c226d57f4980c7

* update

Change-Id: Id67f600fad1a876926cd505dba047cc82011160c

* update

Change-Id: Ia4b0e2a21aa5e12570a80713432fd48ddfb210e6

* optimize the code

Change-Id: Idf8080c7b17c25e14fe34ef6bad1e1150dab58d6

* update

Change-Id: I904f0120a728b4eb87226159f9c0cde3d18ef26a

* update code

Change-Id: I21653d6bcad905daa8f10d12298d1d27535af9d9

* update

Change-Id: I712b9cde9a18c730fd020ea76f05560e594a9edd

* update

Change-Id: Iafe10c007e9b5057212e2dcfb21671f970b1d344

* update

Change-Id: I40c1c7f54852ee033e0caa22573436ee505a27b8

* optimize the code

Change-Id: Iae006b01608df4f363c63a0ae876dbf63cd56fbd

---------

Co-authored-by: drizzle.zk <drizzle.zk@alibaba-inc.com>
Co-authored-by: zhouli11 <04081337@163.com>
2025-12-11 15:13:56 +08:00
majialong f73fe6c4fb [ISSUE #9885] Fix tiered store cache count and bytes metrics (#9886) 2025-12-11 10:27:08 +08:00
dingshuangxi888 1f387b286b Fix ACL 2.0: correct consumer group extraction from retry topic in SEND_MESSAGE/SEND_MESSAGE_V2/SEND_BATCH_MESSAGE (#9911) 2025-12-10 15:58:10 +08:00
rongtong 89e021e871 [ISSUE #9898] Remove AbstractBrokerRunnable and replace with Runnable
Change-Id: I94104151c452d09cbe195a3e1126a473b662a337

Co-authored-by: RongtongJin <user@example.com>
2025-12-05 14:03:54 +08:00
littleboy 1bb2168bf3 Fix controller mode HAService removeConnection (#9897)
* fix controller mode HAService removeConnection

* fix store test
2025-12-05 11:28:07 +08:00
qianye cbfd37b251 Add some log for gRPC route (#9896) 2025-12-05 10:19:27 +08:00
yx9o d7e27d6d69 [ISSUE #9396] Use fastjson2 in all modules (#9397)
* Use fastjson2 in all modules

* Update test

* Update test

* Update test

* Add serialization compatibility test tool class

* Update RemotingSerializableCompatTest.java

* Update RemotingSerializableCompatTest.java

* Update RemotingSerializableCompatTest.java

* Update BitSet problem

* Update

* Update

* Update test

* Update test

* Update BUILD.bazel

* Update BUILD.bazel

* Update test

* Update BitSet problem

* Add test

* Add compat test

* merge develop

* Update test

* merge develop
2025-12-04 19:09:08 +08:00
majialong 47c6e89589 [ISSUE #9894] Update README for RocketMQ 5.3.4 and minor fixes (#9895) 2025-12-04 10:05:03 +08:00
rongtong 1a3c922fdf Defer the shutdown behavior of popConsumerService to prevent JVM crash (#9889)
Change-Id: Iaa23996d94f81ed3250b8d528338e8502a35cada

Co-authored-by: RongtongJin <user@example.com>
2025-12-03 14:15:22 +08:00
yx9o 9f58198abd [ISSUE #9883] Remove unnecessary MessageFormat.format (#9884)
* [ISSUE #9883] Remove unnecessary MessageFormat.format

* Update import
2025-12-03 13:51:13 +08:00
qianye bca6393261 [ISSUE #9891] Optimize pop orderly implementation to facilitate expansion (#9892)
Change-Id: Ie2faff9942027a510c4550a9f2bf2df8c6283137
2025-12-02 16:30:15 +08:00
lizhimins 63d20eb92a [ISSUE #9734] Set revision to 5.3.4 in maven pom (#9876)
Change-Id: I30234c0c2953bea1e09283610bee6851a89d34c0

Signed-off-by: terrance.lzm <terrance.lzm@alibaba-inc.com>
rocketmq-all-5.3.4
2025-11-27 11:32:42 +08:00
lizhimins b77f2ab3a4 [ISSUE #9734] Prepare to release Apache RocketMQ 5.3.4 (#9861)
Change-Id: I2a9e9b99223ed2f98b7611619bff369d83b3e1ea

Signed-off-by: terrance.lzm <terrance.lzm@alibaba-inc.com>
2025-11-26 14:07:50 +08:00
rongtong e87f9cbb08 [ISSUE #9875] Optimize the RocksDB config shutdown logic when useSingleRocksDBForAllConfigs is set to true to prevent JVM crashes. (#9874)
* Optimize the RocksDB config shutdown logic when useSingleRocksDBForAllConfigs is set to true to prevent JVM crashes.

Change-Id: I309e8d13b6adc46d68146c05ffd7e026e2852ad8

* Fix bug

Change-Id: Ie577e32f65a3902dd60d654f80a8e7eda5790fbf

---------

Co-authored-by: RongtongJin <user@example.com>
2025-11-26 11:21:01 +08:00
lizhimins e984023d31 [ISSUE #9816] Fix calculate consumer lag with opentelemetry (#9873) 2025-11-25 19:52:21 +08:00
lizhimins f33f626114 [ISSUE #9663] Add flatten-maven-plugin plugin (#9866)
Change-Id: Ic339c1e6622fbf8d48a0257ef532831d268325a2
2025-11-24 19:28:51 +08:00
sinberCS 12774c64be [ISSUE #9779] fix DirectBuffer will cause error at 9+ JDK version. (#9801)
* fix(DirectBuffer): issue#9779,fix the promblem of 'DirectBuffer will cause error at 9+ JDK version'.

Change-Id: I4657ecc401046a3b0d29b466ee68845f45d34105

* fix(DirectBuffer): issue#9779,fix the promblem of 'DirectBuffer will cause error at 9+ JDK version'.

Change-Id: Iff0880f694cccfa86b812b81260dfe09e4763fa9
2025-11-24 18:00:38 +08:00
majialong 736f027c9c [ISSUE #9870] Ensure metadata provider cache executors are shutdown correctly (#9871)
* [ISSUE #9870] Ensure metadata provider cache executors are shutdown correctly

* Improve test comments
2025-11-24 10:34:43 +08:00
dingshuangxi888 5892de6d14 [ISSUE #9862] [Bug] Fix the issue of missing bornTime in POP requests when broker ACL is enabled (#9863) 2025-11-20 20:09:43 +08:00
qianye ccf973081e [ISSUE #9789] LitePullConsumer supports manually adding subscription reported in Heartbeat (#9790) 2025-11-20 19:53:21 +08:00
majialong a68a5bfd8c [ISSUE #9809] Fix NPE in getAcl when subject is null (#9810) 2025-11-20 11:50:50 +08:00
majialong 963c0e28ff [ISSUE #9741] Optimize authorization whitelist lookup efficiency (#9760)
* [ISSUE #9741] Optimize authorization whitelist lookup efficiency

* Remove unused import

* Fix get authorization metadata provider.
2025-11-20 10:31:46 +08:00
majialong 8eabe68acd [ISSUE #9849] Correct ACL cache loader error log in ClusterMetadataService (#9850) 2025-11-20 10:30:06 +08:00
qianye 7acfe4dca1 [ISSUE #9737] Fix client memory leak on connection failure (#9740) 2025-11-19 16:22:07 +08:00
yx9o d08f787771 [ISSUE #9807] Optimize log.warn Time Consumption in the send Method (#9808) 2025-11-19 16:05:36 +08:00
qianye d750461f3c [ISSUE #9857] Optimize the performance of the notification by removing unnecessary retry checks (#9858)
Change-Id: Iddb8841defd4a33e65080c2451df466d045e4a23
2025-11-18 20:58:36 +08:00
qianye 9c3e7fe273 [ISSUE #9847] Reduce lock contention on the HandleData object to prevent threads from hanging (#9848) 2025-11-14 15:11:40 +08:00
yx9o 6c798d64f0 [ISSUE #9593] Optimize Deflater resource release (#9594) 2025-11-14 13:44:15 +08:00
rongtong 69e2524c45 Fix resource leak in IndexStoreFile shutdown (#9840)
* Fix resource leak in IndexStoreFile shutdown

Add cleanResources() calls after shutdown() for both mappedFile and compactMappedFile to ensure proper cleanup of memory-mapped buffers and file channels.

Change-Id: I2716b4e3b0cd281e89a9d5a00a389dc6048de3e7
Co-developed-by: Cursor <noreply@cursor.com>

* Add a FileNotFoundException check to allow breaking out of the loop after shutdown

Change-Id: Icc0063544ef91de8b2bd96a80f3829a6922cb0e6

* Add a FileNotFoundException check to allow breaking out of the loop after shutdown.

Change-Id: I53a7d2800775d80c1db8feb159c5c258b3517f09

---------

Co-authored-by: RongtongJin <user@example.com>
Co-authored-by: ShannonDing <dinglei@apache.org>
2025-11-14 11:32:35 +08:00
rongtong 2017630383 [ISSUE #9834] Support writeWithoutMmap in IndexStoreFile (#9835)
* Use FileChannel for writing when writeWithoutMmap is enabled in IndexStoreFile

Change-Id: I23ac2a4dfb8286cd8c3e51aeeb2d54d91136bc03
Co-developed-by: Cursor <noreply@cursor.com>

* Use FileChannel for writing when writeWithoutMmap is enabled in IndexStoreFile

Change-Id: I6a541d13c81a16f39b88ac91ce770717f60d64ff
Co-developed-by: Cursor <noreply@cursor.com>

* Remove unnecessary rewind() call in IndexStoreFile when using FileChannel

Change-Id: Id6deca99d34736761fd1d937f5eb5e75506ba1cc
Co-developed-by: Cursor <noreply@cursor.com>

* Add parameterized test for writeWithoutMmap in IndexStoreFileTest

Change-Id: I1ce92e4f728a018ff7bd3160995f395b480345ea
Co-developed-by: Cursor <noreply@cursor.com>

* Fix compactToNewFile to read data from file when using FileChannel

Change-Id: I9058b08f1bbcf646b5e7913260a5eefe853b9b16
Co-developed-by: Cursor <noreply@cursor.com>

* Fix newBuffer position and limit in compactToNewFile

Change-Id: I1a0100b6159d636a8db1124e3de416b3a2e62bc5
Co-developed-by: Cursor <noreply@cursor.com>

* Update test parameter order in IndexStoreFileTest

Change-Id: Ie01656574c1866badf726ead58a8ad2ca3d01cf7
Co-developed-by: Cursor <noreply@cursor.com>

---------

Co-authored-by: RongtongJin <user@example.com>
2025-11-13 17:25:31 +08:00
rongtong e60b67afe7 [ISSUE #9838] IndexStoreService use forceShutdown when disk is not writable (#9839)
* Update store and tieredstore implementation

Change-Id: I29c931148110c4238ce9a256ab2bf69d7b6139a8
Co-developed-by: Cursor <noreply@cursor.com>

* Fix UT NPE

Change-Id: I699ec538118166743308af9e78da50f2aa1b56b3

---------

Co-authored-by: RongtongJin <user@example.com>
2025-11-13 17:25:09 +08:00