Commit Graph

8254 Commits

Author SHA1 Message Date
lk 1a681bdf9b [maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377) rocketmq-all-5.1.4 2023-09-21 19:58:29 +08:00
Jixiang Jin b8610d87bb Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter. (#7373)
* Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter.

* Fix bazel workspace

* Move OtlpJsonLoggingMetricExporter to proxy and controller.

* Fix Bazel imports.
2023-09-21 16:21:44 +08:00
lk 42fcd278ca [ISSUE #7374] Prepare to release Apache RocketMQ 5.1.4 (#7375) 2023-09-20 15:41:23 +08:00
rongtong f05a8da760 Print admin queue watermark in log (#7372) 2023-09-20 15:06:21 +08:00
lizhimins 831fcc76cd [ISSUE #7363] Fix get message from tiered storage return incorrect next pull offset (#7365) 2023-09-19 10:04:04 +08:00
guyinyou 4a8e0d5b85 [ISSUE #7351] Allow mqadmin to operate slave nodes
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
2023-09-13 16:08:03 +08:00
lizhimins fd32dae2ab [ISSUE #6633] Not clear uninitialized files and fix metadata recover (#7342) 2023-09-12 19:58:08 +08:00
yuz10 1a8e7cb17c [ISSUE #7345] Fix wrong result of searchOffset in tiered storage 2023-09-12 19:33:41 +08:00
Jixiang Jin dddd58d2cc Set experimental_ui_max_stdouterr_bytes to 10MB in bazel (#7348)
* Set experimental_ui_max_stdouterr_bytes to 10MB and Fix IT
2023-09-12 19:17:36 +08:00
Ao Qiao dad6ad09d1 [ISSUE #7340] Abstract Duplicate code into a method in TopicConfigManager (#7341) 2023-09-12 08:28:45 +08:00
guyinyou 57f04c95d3 [ISSUE #7343] Rollback modifications to registerProcessor
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
2023-09-11 18:23:25 +08:00
rongtong a9e353285c Add the configuration of topicQueueLock number to better support different scenarios (#7317) 2023-09-11 15:55:18 +08:00
Ziyi Tan 0dbd0772b9 [ISSUE #7326] Split the request to register to the nameserver (#7325)
Signed-off-by: Ziy1-Tan <ajb459684460@gmail.com>
2023-09-11 15:48:07 +08:00
Ziyi Tan dad6b4dadf [ISSUE #7334] registerIncrementBrokerData for single topic update (#7335)
Signed-off-by: Ziy1-Tan <ajb459684460@gmail.com>
2023-09-11 14:34:10 +08:00
guyinyou c100d815d7 [ISSUE #7328] Convergent thread pool creation (#7329)
* Convergence thread pool creation to facilitate subsequent iteration management

* Convergence thread pool creation in ThreadPoolMonitor.java

* fix unit test

* Convergence ThreadPool constructor

* Convergence ScheduledThreadPool constructor

* remove unused import

* Convergence ScheduledThreadPool constructor

* remove unused import

---------
2023-09-11 10:13:56 +08:00
Ji Juntao 6fd0073d64 [ISSUE #7319] Optimize fault-tolerant mechanism for sending messages and hot update switch (#7320) 2023-09-07 20:21:16 +08:00
rongtong 628020537f [ISSUE #7293] Fix NPE when alter sync state set 2023-09-07 16:17:47 +08:00
lizhimins e11e29419f [ISSUE #7308] Adding topic blacklist and filter in tiered storage module (#7310) 2023-09-06 20:42:24 +08:00
lizhimins 37017dbaec [ISSUE #7305] Fix metrics and transactional module not shutdown while broker offline cause coredump(#7307) 2023-09-06 15:23:15 +08:00
yuz10 d67b9d64cb [ISSUE #7302] Fix singleTopicRegister code deleted in merge 2023-09-06 14:07:23 +08:00
guyinyou 31d10385d1 [ISSUE #7289] Fixed asynchronous send backpressure capability
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
2023-09-04 14:09:32 +08:00
cnScarb f82718ae3b [ISSUE #7208] fix: when deleting topic also delete its pop retry topic (#7209) 2023-08-31 15:50:10 +08:00
yuz10 d000ef947d [ISSUE #7283] Incorrect dledger commitlog min offset after mappedFile re delete failed (#7284) 2023-08-31 09:41:33 +08:00
lizhimins c78061bf6c [ISSUE#7280] Fix and refactor handle commit exception in tiered storage (#7281)
* refactor handle commit exception

* refactor handle commit exception

* fix handle commit exception
2023-08-30 22:29:51 +08:00
PiteXChen bd0e9c09db [ISSUE #7111] Remove responseFuture from the responseTable when exception occurs (#7112)
* remove responseFuture when exception
* Empty-Commit

---------
Co-authored-by: chenyong152 <chenyong152@midea.com>
2023-08-29 19:39:27 +08:00
Ji Juntao b028277018 [ISSUE #6567] [RIP-63] Queue Selection Strategy Optimization (#6568)
Optimize the proxy's and client's selection strategy for brokers when sending messages, and use multiple selection strategies as a pipeline to filter suitable queues.
2023-08-29 16:13:38 +08:00
ShuangxiDing 9f34f55e1d [ISSUE #7226] Filter tlvs in ppv2 which contents not are spec-compliant ASCII characters and space (#7227)
Filter tlvs in ppv2 which not are spec-compliant ASCII characters and space
2023-08-29 15:48:46 +08:00
yuz10 fa54915437 [ISSUE #7261] Slave high CPU usage when enableScheduleAsyncDeliver=true (#7262)
* [ISSUE #6390] Add break to the exception of WHEEL_TIMER_NOT_ENABLE.

* fix broker start fail if mapped file size is 0

* log

* only delete the last empty file

* change dataReadAheadEnable default to true

* fix endless loop when master change to slave.
2023-08-29 15:22:09 +08:00
Ziyi Tan 3e100103af [ISSUE #7277] Enhance rocksDBConfigToJson to support metadata counting (#7276) 2023-08-29 13:48:51 +08:00
mxsm b4f73e2aab [ISSUE #7271] Optimize the configuration for setting the quantity of TimerDequeuePutMessageService (#7272) 2023-08-27 20:58:58 +08:00
Ziyi Tan 5f6dc90f9d [ISSUE #7250] Beautify command rocksDBConfigToJson output
Co-authored-by: Ziy1-Tan <ajb4596984460@gmail.com>
2023-08-25 11:17:23 +08:00
Zhouxiang Zhan 7e018520ef Add expireAfterAccess for cache (#7247)
Add expireAfterAccess for cache
2023-08-25 09:49:22 +08:00
lk 77e8e54b37 [ISSUE #7223] Support batch ack for grpc client in proxy (#7225) 2023-08-23 15:56:39 +08:00
echooymxq 017ad11047 [ISSUE #7219] Fix Concurrent modify syncStateSet and Mark synchronizing frequently when shrink. (#7220) 2023-08-23 11:11:42 +08:00
石臻臻(Steven shi) 3884f59594 [ISSUE #7149] When creating and updating Topic, there will be problems with permission settings (#7151)
* [ISSUE #7149] fix bug : When creating and updating Topic, there will be problems with permission settings

* [ISSUE #7149] fix bug : When creating and updating Topic, there will be problems with permission settings

* [issue#7249]

---------

Co-authored-by: 十真 <shirenchuang.src@cainiao.com>
2023-08-23 11:10:30 +08:00
guyinyou 69c26d3d29 [ISSUE #7228] Converge the use of some important variables for some class 2023-08-23 10:27:52 +08:00
lizhimins 9bb73b9a38 [#ISSUE 7222] Bug fix and refactoring of the Indexfile in tiered storage (#7224) 2023-08-23 09:46:27 +08:00
mxsm bdede35db3 [ISSUE #7124] Fix the typos in the code comments (#7125) 2023-08-23 08:34:56 +08:00
Ziyi Tan 744167bd01 [ISSUE #7142] Add command RocksDBConfigToJson to inspect rocksdb content (#7180)
* feat: add command `RocksDBConfigToJson` to inspect rocksdb content

Signed-off-by: Ziy1-Tan <ajb4596984460@gmail.com>

* refactor: fix style

---------

Signed-off-by: Ziy1-Tan <ajb4596984460@gmail.com>
Co-authored-by: Ziy1-Tan <ajb4596984460@gmail.com>
2023-08-23 08:32:17 +08:00
yx9o fec1414814 [ISSUE #7166] Optimize the display format of admin (#7210) 2023-08-23 08:22:34 +08:00
rongtong cc16a1b512 Set table reference the same object for setSubscriptionGroupTable method (#7204) 2023-08-22 10:42:25 +08:00
lk 72d796f2b2 [ISSUE #7205] support batch ack for pop orderly (#7206) 2023-08-18 11:55:39 +08:00
yao-wenbin 05e7cde610 [ISSUE #7042] maven-compile job failed, Because TlsTest's serverRejectsSSLClient test case will throw TooLongFrameException (#7179) 2023-08-18 09:49:59 +08:00
iamgd67 2b93e1e32f Update mqbroker to use runbroker.sh instead of runserver.sh when use --enable-proxy (#7150)
Update mqbroker to use runbroker.sh instead of runserver.sh when enabling `--enable-proxy`
this allow JVM `heap` and `gc` configuration using broker's settings instead of other common serverices'(proxy,namenode, etc).
our main purpose, like the filename `mqbroker` suggest, is to start broker (which embeds a proxy), so use broker's config is reasonable

chinese version
mqbroker的--enable-proxy选项是启动内嵌了proxy的broker,而不是内嵌broker的proxy,而且broker的工作量和重要程度大于proxy,所以使用broker的gc和heap配置更合适
2023-08-17 15:31:14 +08:00
guyinyou 3df1b9232a [ISSUE #7201] Remove the DefaultMessageStore.class dependency in TransientStorePool
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
2023-08-17 13:59:04 +08:00
Ziyi Tan a4bcc2a74d [ISSUE #7178] refresh metadata after broker startup
Signed-off-by: Ziy1-Tan <ajb459684460@gmail.com>
2023-08-17 13:53:48 +08:00
Jixiang Jin 50d1050437 To config the cardinalityLimit for openTelemetry metrics exporting and fix logging config for metrics (#7196) 2023-08-16 21:15:00 +08:00
Zhouxiang Zhan 5a3de926b8 Optimize updateSubscription check exist loop (#7190) 2023-08-16 20:52:53 +08:00
yx9o a9c0b43f7f [ISSUE #7192] Correct typos (#7193) 2023-08-16 18:45:00 +08:00
redlsz 55e0cdb2af fix: IndexOutOfBoundsException when process pop response (#7003) 2023-08-15 19:19:45 +08:00