Commit Graph

8217 Commits

Author SHA1 Message Date
mxsm bdede35db3 [ISSUE #7124] Fix the typos in the code comments (#7125) 2023-08-23 08:34:56 +08:00
Ziyi Tan 744167bd01 [ISSUE #7142] Add command RocksDBConfigToJson to inspect rocksdb content (#7180)
* feat: add command `RocksDBConfigToJson` to inspect rocksdb content

Signed-off-by: Ziy1-Tan <ajb4596984460@gmail.com>

* refactor: fix style

---------

Signed-off-by: Ziy1-Tan <ajb4596984460@gmail.com>
Co-authored-by: Ziy1-Tan <ajb4596984460@gmail.com>
2023-08-23 08:32:17 +08:00
yx9o fec1414814 [ISSUE #7166] Optimize the display format of admin (#7210) 2023-08-23 08:22:34 +08:00
rongtong cc16a1b512 Set table reference the same object for setSubscriptionGroupTable method (#7204) 2023-08-22 10:42:25 +08:00
lk 72d796f2b2 [ISSUE #7205] support batch ack for pop orderly (#7206) 2023-08-18 11:55:39 +08:00
yao-wenbin 05e7cde610 [ISSUE #7042] maven-compile job failed, Because TlsTest's serverRejectsSSLClient test case will throw TooLongFrameException (#7179) 2023-08-18 09:49:59 +08:00
iamgd67 2b93e1e32f Update mqbroker to use runbroker.sh instead of runserver.sh when use --enable-proxy (#7150)
Update mqbroker to use runbroker.sh instead of runserver.sh when enabling `--enable-proxy`
this allow JVM `heap` and `gc` configuration using broker's settings instead of other common serverices'(proxy,namenode, etc).
our main purpose, like the filename `mqbroker` suggest, is to start broker (which embeds a proxy), so use broker's config is reasonable

chinese version
mqbroker的--enable-proxy选项是启动内嵌了proxy的broker,而不是内嵌broker的proxy,而且broker的工作量和重要程度大于proxy,所以使用broker的gc和heap配置更合适
2023-08-17 15:31:14 +08:00
guyinyou 3df1b9232a [ISSUE #7201] Remove the DefaultMessageStore.class dependency in TransientStorePool
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
2023-08-17 13:59:04 +08:00
Ziyi Tan a4bcc2a74d [ISSUE #7178] refresh metadata after broker startup
Signed-off-by: Ziy1-Tan <ajb459684460@gmail.com>
2023-08-17 13:53:48 +08:00
Jixiang Jin 50d1050437 To config the cardinalityLimit for openTelemetry metrics exporting and fix logging config for metrics (#7196) 2023-08-16 21:15:00 +08:00
Zhouxiang Zhan 5a3de926b8 Optimize updateSubscription check exist loop (#7190) 2023-08-16 20:52:53 +08:00
yx9o a9c0b43f7f [ISSUE #7192] Correct typos (#7193) 2023-08-16 18:45:00 +08:00
redlsz 55e0cdb2af fix: IndexOutOfBoundsException when process pop response (#7003) 2023-08-15 19:19:45 +08:00
yx9o ac411daa27 [ISSUE #7183] Correct mismatched commandDesc (#7184) 2023-08-15 08:31:00 +08:00
yx9o 25005060bb [ISSUE #7176] Correct mismatched logs (#7177) 2023-08-13 20:52:17 +08:00
yx9o 1f04e68a2e [ISSUE #7172] Unified Chinese for Name Server (#7173) 2023-08-12 21:12:22 +08:00
Zhouxiang Zhan db58f00c0f [ISSUE #7169] Change metadataThreadPoolQueueCapacity to 100000 (#7170) 2023-08-11 19:18:30 +08:00
Steven f534501855 [Feature 7155] add errlog when cmd err (#7157)
Co-authored-by: 十真 <shirenchuang.src@cainiao.com>
2023-08-11 10:25:48 +08:00
ShuangxiDing 8741ff8c9b [ISSUE #7153] Add switch for MIXED message type (#7154)
Add a switch for MIXED message type when creating a Topic in the Broker.
2023-08-10 17:41:15 +08:00
caigy c0ba453f38 [ISSUE #7129] Fix resource collisions in acl tests (#7130)
* run acl tests sequencially to avoid collision

* disable reuseForks for acl like broker

* Revert "[ISSUE #7135] Temporarily ignoring plainAccessValidator test (#7135)"

This reverts commit 6bc2c8474a.
2023-08-10 14:08:17 +08:00
ShuangxiDing 99b39a35f2 [ISSUE #7115] Fix grpc response message NPE (#7116) 2023-08-10 11:28:39 +08:00
lizhimins b2deef179d [ISSUE #7144] Accelerate the recovery speed of the tiered storage module (#7145) 2023-08-10 10:38:47 +08:00
rongtong bcba5a8e62 [ISSUE #7146] Log output error needs to be corrected (#7147) 2023-08-10 10:19:34 +08:00
lk 04683ec058 [ISSUE 7117] check message is in memory or not when init consumer offset for pop (#7118) 2023-08-09 19:08:33 +08:00
rongtong 6bc2c8474a [ISSUE #7135] Temporarily ignoring plainAccessValidator test (#7135) 2023-08-09 16:11:37 +08:00
fujian-zfj 3a6ef0400c [ISSUE #7064] [RIP-66-1] Support KV(RocksDB) Storage for Metadata (#7092)
* typo int readme[ecosystem]

* rocksdb metadata

* add unit test

* fix testOffsetPersistInMemory

* fix unit test

* fix unit test

* remove unused import

* move RocksDBOffsetSerialize to broker moudle

* Fix bazel build scripts

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Flag QueryMsgByKeyIT as flaky as it fails at frequency: 5 out of 32

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* change public to private of some inner method

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2023-08-05 00:32:11 +08:00
haolinkong c73d8ee346 [ISSUE #6962]operation.md Format adjustment 2023-08-04 10:41:41 +08:00
ShuangxiDing 3bdabf703b [ISSUE #7109] support the mixed topic type (#7110)
* Add mixed message type.

* support mixed topic type for grpc server

* remove the unnecessary parentheses around expression

* format the javadoc
2023-08-03 16:10:24 +08:00
koado 1fe5d62334 [ISSUE #7074] Allow a BoundaryType to be specified when retrieving offset based on the timestamp (#7082)
* add new interface for searching offset with boundary type

* format code

* fix failed test

* unify two BoundaryType class

* add interface getOffsetInQueueByTime(long timestamp, BoundaryType boundaryTYpe) in ConsumeQueueInterface

* fix AdminBrokerProcessorTest unnecessary Mockito stubbings
2023-08-03 11:40:16 +08:00
rongtong c06facf089 [ISSUE #7102] Making perm equal to 0 is valid 2023-08-03 11:39:24 +08:00
Zhouxiang Zhan ab61183030 [ISSUE #7104] Add ReceiptHandleGroupKey for RenewEvent (#7105) 2023-08-01 19:00:15 +08:00
lizhimins a1bf49d5d0 [ISSUE #7093] Avoid dispatch tasks too much cause dispatch task failed (#7094)
* Avoid dispatch tasks too much cause dispatch task failed

* set schedule task async
2023-08-01 15:56:34 +08:00
weihubeats 8bcc94829d [ISSUE #7077] Schedule CQ offset invalid. offset=77, cqMinOffset=0, cqMaxOffset=74, queueId=1 (#7084)
* Adding null does not update

* delete slave put correctDelayOffset

* Remove duplicate delayOffset file loading

* add loadWhenSyncDelayOffset

* add method

* add method
2023-08-01 10:15:07 +08:00
Zack_Aayush 8baa51e85e [ISSUE #7091] Update the cd command in README (#7096)
* Update the cd command

* Removed extra space

---------

Co-authored-by: Aayush <aaayush@redhat.com>
2023-07-30 11:32:02 +08:00
cnScarb d429bd72df [ISSUE #7039] Fix retry message filter when subtype is TAG (#7040) 2023-07-28 09:46:39 +08:00
zd46319 d0a69be563 [ISSUE #6810] Fix the bug of mistakenly deleting data in clientChannelTable when the channel expire (#7073) 2023-07-27 16:56:41 +08:00
Vincent Lee d797377880 [ISSUE #7056] Avoid close success channel if invokeSync most time cost on get connection for channel (#7057)
* fix: avoid close success channel if invokeSync most time cost on get channel

Change-Id: I29741cf55ac6333bfa30fef755357b78a22b1325

* fix: ci style

Change-Id: I8c9b86e9cb6f1463bf213e64c9b8c139afa794c8
2023-07-27 10:51:51 +08:00
gaoyf 32eb1d5557 [ISSUE #7068] Fix failed to create syncer topic when the proxy was just started (#7076) 2023-07-25 15:26:20 +08:00
rongtong 047ef7498f Ensuring consistency between broker and nameserver data when deleting a topic (#7066)
Co-authored-by: 尘央 <xinyuzhou.zxy@alibaba-inc.com>
2023-07-25 14:00:22 +08:00
吴星灿 3102758487 fix: npe in lockBatchMQ and unlockBatchMQ (#7078)
Co-authored-by: wxc <wuxingcan666@foxmail.com>
2023-07-25 13:47:53 +08:00
maclong1989 8027cfc7cb [ISSUE #7063] doc: fix typo in user_guide.md
Signed-off-by: jiangyl3 <jiangyl3@asiainfo.com>
Co-authored-by: jiangyl3 <jiangyl3@asiainfo.com>
2023-07-23 09:15:05 +08:00
ShuangxiDing 90c5382aee [ISSUE #7061] Support forward HAProxyMessage for Multi Protocol server. (#7062)
* Support dynamic modification of grpc tls mode to improve the scalability of ProtocolNegotiator

* Support dynamic modification of grpc tls mode to improve the scalability of ProtocolNegotiator

* [ISSUE #6866] Move the judgment logic of grpc TLS mode to improve the scalability of ProtocolNegotiator

* [ISSUE #6866] Move the judgment logic of grpc TLS mode to improve the scalability of ProtocolNegotiator

* [ISSUE #6866] Move the judgment logic of grpc TLS mode to improve the scalability of ProtocolNegotiator

* [ISSUE #6866] Move the judgment logic of grpc TLS mode to improve the scalability of ProtocolNegotiator

* Support proxy protocol for gRPC server.

* Support proxy protocol for gRPC server.

* Support proxy protocol for gRPC server.

* Support proxy protocol for gRPC server.

* Support proxy protocol for gRPC server.

* Support proxy protocol for gRPC and Remoting server.

* 回滚netty的升级

* Support proxy protocol for gRPC and Remoting server.

* Support proxy protocol for gRPC and Remoting server.

* Support proxy protocol for gRPC and Remoting server.

* add grpc-netty-codec-haproxy in bazel

* add grpc-netty-codec-haproxy in bazel

* Support proxy protocol for gRPC and Remoting server.

* Fix Test

* add grpc-netty-codec-haproxy in bazel

* add ProxyProtocolTest for Remoting

* Support HAProxyMessage forward for multi protocol server.

---------

Co-authored-by: 徒钟 <shuangxi.dsx@alibaba-inc.com>
2023-07-21 20:28:58 +08:00
guyinyou af993d28e2 [ISSUE #3717][RIP-27] Auto batching in producer
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
2023-07-21 09:31:56 +08:00
wenbin yao 804f2d85f2 [ISSUE ##7036] rename method: getWriteQueueIdByBroker to getWriteQueueNumsByBroker(#7037)
* [ISSUE ##7036] rename method: getWriteQueueIdByBroker to getWriteQueueNumsByBroker

* [ISSUE #7036] rename method from getWriteQueueIdByBroker to getWriteQueueNumsByBroker
2023-07-20 11:01:38 +08:00
gaoyf ebad3c8a6b [ISSUE #7047] NettyRemotingClient#invokeOneway throw Exception with address 2023-07-20 10:59:40 +08:00
lizhimins 2c5808b9fd [#ISSUE 7035] Fix correct min offset behavior in tiered storage (#7038) 2023-07-19 20:14:02 +08:00
lk e0f5295fed passing the renew event type to create the correct context (#7045) 2023-07-19 15:55:11 +08:00
leeyiyu 7996ec3b3f [ISSUE #6879] ConcurrentHashMapUtils fails to solve the loop bug in JDK8 (#6883) 2023-07-18 20:58:56 +08:00
rongtong 737c1e5338 [ISSUE #7029] Add a config to determine whether pop response should return the actual retry topic or tamper with the original topic (#7030) 2023-07-18 14:12:39 +08:00
fuyou001 440be1ed4c [ISSUE #7031] fix Pop caused broker memory leak bug (#7032) 2023-07-17 19:23:23 +08:00