Commit Graph

8838 Commits

Author SHA1 Message Date
huanzhikang 275cc65dd7 [ISSUE #9491] Remove the volatile declaration for the two variables requestsWrite and requestsRead in the GroupCommitService class (#9492) 2025-06-28 14:30:54 +08:00
EnableAsync 832562f028 [ISSUE #8920] Refactor SSL context loading process to support multiple protocols dynamic loading (#9483)
* feat(proxy): 添加 gRPC 和 Remoting 服务器的 TLS 证书热更新支持

- 在 GrpcServer 和 RemotingProtocolServer 中添加文件监视服务,用于监控 TLS 证书和密钥的变化
- 实现证书和密钥变更时重新加载 SSL 上下文的逻辑
- 优化 ProxyAndTlsProtocolNegotiator 中的 SSL 上下文加载过程
- 添加日志记录,方便调试和监控 TLS 相关操作

* refactor(proxy): 重构 gRPC 证书监控逻辑并添加单元测试

- 重构 GrpcServer 中的证书监控逻辑,提取到独立的 GrpcCertKeyFileWatchListener 类中
- 优化证书变更处理流程,提高代码可读性和维护性
- 新增 GrpcServerTest 类,为 gRPC服务器和证书监控添加单元测试- 测试覆盖了各种证书变更场景,包括单独变更和组合变更
- 验证了证书变更时 SSLContext 的重新加载和错误处理

Signed-off-by: Async <raisinata@foxmail.com>

* refactor(proxy): 重构 gRPC 证书监控逻辑并添加单元测试

- 重构 GrpcServer 中的证书监控逻辑,提取到独立的 GrpcCertKeyFileWatchListener 类中
- 优化证书变更处理流程,提高代码可读性和维护性
- 新增 GrpcServerTest 类,为 gRPC服务器和证书监控添加单元测试- 测试覆盖了各种证书变更场景,包括单独变更和组合变更
- 验证了证书变更时 SSLContext 的重新加载和错误处理

Signed-off-by: Async <raisinata@foxmail.com>

* fix: code format

Signed-off-by: Async <raisinata@foxmail.com>

* test: add test cases

Signed-off-by: Async <raisinata@foxmail.com>

* fix: code format

Signed-off-by: Async <raisinata@foxmail.com>

* refactor(proxy): 重构 TLS证书更新逻辑

- 移除 FileWatchService,改用 TlsCertificateManager 统一管理 TLS证书
- 实现 TlsContextReloadListener 接口,响应 TLS 证书更新
- 优化 GrpcServer 和 RemotingProtocolServer 中的 TLS 证书更新逻辑
- 新增单元测试验证 TLS 证书更新功能

Signed-off-by: Async <raisinata@foxmail.com>

* test(proxy): 优化 TLS 相关测试用例

- 重构了多个测试类中的重复代码- 提高了测试的可读性和维护性
- 确保在测试中正确关闭资源

Signed-off-by: Async <raisinata@foxmail.com>

* refactor(proxy): 优化代码导入结构

- 移除了不必要的导入项
- 显式导入了所有活动类,提高了代码的可读性和维护性

Signed-off-by: Async <raisinata@foxmail.com>

* update

* fix: no static

Signed-off-by: Async <raisinata@foxmail.com>

* fix: add SingletonHolder for TlsCertificateManager

Signed-off-by: Async <raisinata@foxmail.com>

* refactor

* refactor(proxy): 重构 TLS证书管理

- 将 TlsCertificateManager 实例化移至 ProxyStartup 类
- 更新 GrpcServer 和 RemotingProtocolServer 类以使用 TlsCertificateManager
- 移除冗余的 TLS 证书管理相关测试用例
- 优化 TLS 上下文重载逻辑

Signed-off-by: Async <raisinata@foxmail.com>

* refactor(proxy): 优化日志信息内容

- 将 cert file changed 日志信息改为更通用的 File changed
- 保持代码风格一致性,提高日志的可读性和维护性

Signed-off-by: Async <raisinata@foxmail.com>

* test(proxy): 重构并增强 TlsCertificateManager 测试用例- 重新设计测试用例,使用临时文件模拟证书和密钥
- 增加对 TlsCertificateManager 各种方法的单元测试
- 涉及到的测试场景包括:
  - 构造函数
  - 启动和关闭
  - 注册和注销监听器
  - 文件变更通知(证书、密钥、未知文件等)
  - 多个监听器的情况
  - 监听器抛出异常的情况
  - 增加对内部 CertKeyFileWatchListener 的测试

Signed-off-by: Async <raisinata@foxmail.com>

* refactor

* test(proxy): 优化 TlsCertificateManager 单元测试

-移除了未使用的 import 语句
- 替换了 import static语句,使其更加有序
- 删除了未使用的静态方法断言(verify、times、never)
- 重置了 mock 对象以避免测试之间的干扰

Signed-off-by: Async <raisinata@foxmail.com>

* fix format

Signed-off-by: Async <raisinata@foxmail.com>

* fix format

Signed-off-by: Async <raisinata@foxmail.com>

* fix format

Signed-off-by: Async <raisinata@foxmail.com>

* fix format

Signed-off-by: Async <raisinata@foxmail.com>

* fix format

Signed-off-by: Async <raisinata@foxmail.com>

* fix format

Signed-off-by: Async <raisinata@foxmail.com>

* fix format

Signed-off-by: Async <raisinata@foxmail.com>

* fix format

Signed-off-by: Async <raisinata@foxmail.com>

---------

Signed-off-by: Async <raisinata@foxmail.com>
2025-06-27 09:56:19 +08:00
hqbfz d556460d86 fix: clean pull offset in #removeOffset (#9490)
Co-authored-by: hqbfzwang <hqbfzwang@tencent.com>
2025-06-23 18:41:23 +08:00
WJ66880 8abc0a1cf7 [ISSUE #9481] Fix Issue 4050 didn't fix completely (#9482) 2025-06-20 11:31:11 +08:00
WJ66880 f4e2a4a0e3 [ISSUE #9335] Use MixAll.ROCKETMQ_HOME_DIR for home directory (#9474) 2025-06-18 10:28:35 +08:00
大楚兴 53a3f699f0 Fix IllegalStateException during app shutdown caused by premature shutdown trigger (#9408) 2025-06-09 14:33:21 +08:00
qianye ec4a21c476 [ISSUE #9454] Make sure topic can be deleted when using RocksDB CQ (#9457) 2025-06-09 13:58:53 +08:00
Ji Juntao cfddd12c2c [ISSUE #9451]Optimize back pressure default value to 1024. (#9452) 2025-06-05 19:04:34 +08:00
Crazylychee 4f9d292ee5 [ISSUE #9439] Add escape for win in the method returning broker configuration (#9440) 2025-06-05 17:09:13 +08:00
qianye 9d9431dc1c [ISSUE #9254] Add CombineConsumeQueue to support CQ migration (#9256)
Add CombineConsumeQueue to support CQ migration
2025-06-03 17:23:24 +08:00
yx9o 921664f400 [ISSUE #9443] Fix add wrong value to topicGroupTable in ConsumerManager (#9444) 2025-06-03 10:02:13 +08:00
lizhimins cd6bec6291 [ISSUE #9441] Add file length check in IndexService (#9442) 2025-06-03 09:56:23 +08:00
yangguodong 577371e208 [ISSUE #9352] Fix wrong value in topic-group cache (#9424) 2025-05-30 14:09:26 +08:00
lizhimins c9ea74962f [ISSUE #9418] Fix ColumnFamilyHandle not close in PopConsumerRocksdbStore (#9420) 2025-05-21 18:59:27 +08:00
lizhimins 286557a204 [ISSUE #9379] Set compact timestamp when timeStoreTable empty (#9419) 2025-05-21 17:25:19 +08:00
qianye e1021ecc73 [ISSUE #9416] Fix batch send messages have the same message id when consumed (#9417) 2025-05-21 10:27:23 +08:00
rongtong 46b7a98de0 [ISSUE #9403] Fix the issue of metadata synchronization failure between master and slave when the topic has attributes (#9404) 2025-05-20 10:35:25 +08:00
Ji Juntao 9654299e77 [ISSUE #9412] Flush bak metrics file before deleting the original file (#9413)
* flush bak file before delete original file.

* timer metrics.

* english comment.
2025-05-20 09:47:20 +08:00
mxsm 4d38e96a7d [ISSUE #9414] Updated the Quick Start version in README to the 5.3.3 (#9415) 2025-05-20 09:46:46 +08:00
Liu Shengzhong ed410f37dd [ISSUE #8232] Fix the issue that proxy remoting thread pool isolation does not take effect (#8233) 2025-05-13 13:56:59 +08:00
Liu Shengzhong 01c78d0936 Add RocketmqTraffic appender to rmq.proxy.logback.xml (#8630)
Add RocketmqTraffic appender to rmq.proxy.logback.xml (#8630)
2025-05-13 13:34:55 +08:00
Liu Shengzhong d59a2ddb37 Fix revive lag metric calculation (#8652)
Fix revive lag metric calculation (#8652)
2025-05-13 13:27:16 +08:00
Liu Shengzhong 2379813894 [ISSUE #9253] Make the message visible earlier when response process encounters errors (#9255) 2025-05-13 10:17:13 +08:00
weihubeats 0e19071278 [ISSUE #9337] Upgrade Netty to 4.1.119.Final (#9338) 2025-05-09 15:59:19 +08:00
lizhimins aecb97ec44 [maven-release-plugin] prepare for next development iteration (#9389) 2025-05-07 16:34:04 +08:00
lizhimins 29d90a4ff9 [maven-release-plugin] prepare release rocketmq-all-5.3.3 (#9388) rocketmq-all-5.3.3 2025-05-07 09:48:32 +08:00
lizhimins 4163c7e061 [ISSUE #9381] Prepare to release Apache RocketMQ 5.3.3 (#9385) 2025-05-06 18:54:03 +08:00
lizhimins 449536bed0 Revert "[ISSUE# 9333] Use fastjson2 in broker module (#9334)" (#9387)
This reverts commit b1daa3c0f0.
2025-05-06 17:55:53 +08:00
lizhimins d78ed1c080 Revert "[ISSUE #9188] Use fastjson2 in org/apache/rocketmq/broker/config/v1 (…" (#9386)
This reverts commit f86fb40904.
2025-05-06 17:55:05 +08:00
lizhimins c66e758a1c [ISSUE #9379] Fix timeStoreTable delete logic in IndexService (#9384)
* [ISSUE #9379] Fix timeStoreTable delete logic in IndexService

* [ISSUE #9379] Fix delete logic from TimeStoreTable in IndexService
2025-05-06 15:31:03 +08:00
kaikoo c9deaa538b [ISSUE #9377] fix 'send trace data can fail if shutdown producer immediately' (#9378) 2025-04-30 15:15:59 +08:00
dingshuangxi888 ade18bb076 [ISSUE 9362] [RIP-77] Deprecate and Remove ACL 1.0 (#9363) 2025-04-30 15:02:55 +08:00
qianye 28370f3a87 [ISSUE #9375] Make client trace thread can be closed correctly (#9376) 2025-04-30 10:27:18 +08:00
dingshuangxi888 6819b4d684 [ISSUE #9233] Fix query time boundary calculation in tiered storage (#9374) 2025-04-29 19:41:05 +08:00
lizhimins 8c623df7ad [ISSUE #9371] Delete ConsumeQueue index before CommitLog in tiered storage (#9372) 2025-04-29 10:31:49 +08:00
lizhimins 3c2e81dcd4 [ISSUE #9369] Fix reset offset commit pull offset when use pop consumer service (#9370) 2025-04-28 14:02:22 +08:00
Ji Juntao 9f10d38a23 [ISSUE #9313] Add scheduled clean task. (#9314)
* add scheduled clean task.

* make code compatible to lmq.

* make code compatible to lmq.

* make code compatible to lmq.

* make code compatible to lmq.
2025-04-25 17:46:30 +08:00
yangguodong 7ef36102ea [ISSUE #9351] Add topic-group mapping in queryTopicConsumeByWho command (#9352) 2025-04-23 13:51:01 +08:00
lizhimins 61f50b0fa0 [ISSUE #9360] Fix some services are not shutdown when the broker offline (#9361) 2025-04-23 13:50:08 +08:00
bxfjb 1babb32954 [ISSUE #9358] Timediff should multiply 1000 when query message from tiered storage (#9359) 2025-04-23 10:33:49 +08:00
yx9o b1daa3c0f0 [ISSUE# 9333] Use fastjson2 in broker module (#9334)
* [#ISSUE 9333] Use fastjson2 in broker module

* Update

* Fix the serialization failure caused by improper get/set naming
2025-04-22 10:48:56 +08:00
lizhimins 854369aa38 [ISSUE #9339] Fix pop update consumption offset when message are filtered (#9340) 2025-04-16 16:00:37 +08:00
Jixiang Jin 9adff6a39e Make sure to create system topics to all the brokers in ‘systemTopicClusterName’ cluster. (#9327) 2025-04-16 15:30:55 +08:00
WJ66880 07478ca1c4 [ISSUE #9331] Found one info log lose parameters during proxy startup (#9332) 2025-04-16 11:25:02 +08:00
ymwneu 775eb64b87 [ISSUE #9288] Support the disablement of producer registration and fast channel shutdown (#9293) 2025-04-11 15:45:00 +08:00
yx9o 881507e89f [ISSUE #9115] Optimize the broker's reverse notification for consumerId change (#9116)
* [ISSUE #9115] Optimize the broker's reverse notification for consumerId change
2025-04-11 15:38:07 +08:00
gaoyf 60fab89c22 [ISSUE #9294] Proxy compatible batch message (#9295) 2025-04-11 14:37:54 +08:00
yx9o f86fb40904 [ISSUE #9188] Use fastjson2 in org/apache/rocketmq/broker/config/v1 (#9189) 2025-04-11 14:24:25 +08:00
rongtong e15f36e019 Optimize the log output of tlsHelper (#9324) 2025-04-11 14:21:48 +08:00
ymwneu 689c1ec616 [ISSUE #9302] SendMessageContext add message type (#9303) 2025-04-09 15:39:24 +08:00