opensource/rocketmq
3
0
Fork 0
mirror of https://github.com/apache/rocketmq.git synced 2026-09-17 17:17:55 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,302 Commits 73 Branches 40 Tags
8e7e2b5f50e0db14b77462ef1574d4020c0fd986
Commit Graph
8302 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
guyinyouandguyinyou 8e7e2b5f50 [ISSUE #7574] Fix RunningFlags conflict 
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
 2023-11-20 19:32:57 +08:00
cnScarb 01a2aef96b [ISSUE #7570] Add default value for lastPopTimestamp (#7571) 2023-11-17 15:58:14 +08:00
Jixiang Jin 651a5ca992 [ISSUE #7562] BugFix for estimating message accumulation correctly (#7563) 2023-11-16 10:16:16 +08:00
lizhimins 4791d9a1f1 [ISSUE #5923] Revert "Fix tiered store README.md error about Configuration (#7436)" (#7557) 
This reverts commit 70dc93abbc.
 2023-11-14 17:59:47 +08:00
Zhanhui Li 1be5ebc736 [ISSUE #7551] Reuse helper methods from Netty to free direct byte buffer (#7550) 
* Reuse helper methods from Netty to free direct byte buffer, making codebase JDK 9+ compatible

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Guard against null

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix #7552

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
 2023-11-13 09:45:37 +08:00
Zhanhui Li 15d32db03b [ISSUE #7547] Let consumer be aware of message queue assignment change (#7548) 
* let consumer be aware of message queue assignment change

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* add unit test for DefaultMQPushConsumer#setMessageQueueListener

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix: bazel build warnings

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

* fix: set MixCommitlogTest test size as medium

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

* allow cache bazel test results

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix code style issue by removing unused imports

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* fix #7552

Signed-off-by: Zhanhui Li <lizhanhui@apache.org>

---------

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Signed-off-by: Zhanhui Li <lizhanhui@apache.org>
 2023-11-13 09:44:25 +08:00
Allon Murienik 27759f3556 Fix unstable UtilAllTest#testCalculateFileSizeInPath on Windows (#7419) 
This patch offers an alternative approach to
5d492c3382. Instead of manually setting
up the directory #testCalculateFileSizeInPath needs and then
recursively deleting it, it uses JUnit's TemporaryFolder Rule to
handle all of this work, and allows the code to concentrate on the
business logic.

Closes #7418
 2023-11-09 12:33:34 +08:00
yangguodongandyangguodong.cn 70dc93abbc Fix tiered store README.md error about Configuration (#7436) 
* Fix tiered store README.md error about Configuration

* Fix change tieredStoreFilePath to tieredStoreFilepath

* revert README.md change

---------

Co-authored-by: yangguodong.cn <yangguodong.cn@bytedance.com>
 2023-11-09 11:14:54 +08:00
Dongyuan Pan ead3d90501 [ISSUE #7511] Lock granularity issue causing LMQ message loss (#7525) 
* bug fix: assignOffset and increaseOffset in LMQ has concurrency issues in topicQueueLock, should be in putMessageLock

* fix MultiDispatchTest

* fix MultiDispatchTest

* fix unit test
 2023-11-08 10:40:52 +08:00
lk 00965d8c11 [ISSUE #7531] Clear POP_CK when sending messages (#7532) 2023-11-06 09:46:39 +08:00
fujian-zfj 46962c262c [ISSUE #7523] Message will flush timeout when transientStorePoolEnable=true and flushDiskType=SYNC_FLUSH (#7524) 
* typo int readme[ecosystem]

* enableTransientPool and sync_flush will cause flush_time_out

* polish

* add log
 2023-11-02 13:47:16 +08:00
fuyou001 26fa050148 [ISSUE #7501] The broker supports idempotence in creating topics (#7502) 2023-10-27 16:28:17 +08:00
rongtong 48ef5ced46 [ISSUE #7505] Do not validate the length when deleting a topic 2023-10-26 14:43:24 +08:00
guyinyouandguyinyou 91349f30b9 [ISSUE #7437] Add the CRC check of commitlog (#7468) 
* Added CRC32 check for full data

* add unit test

* add MessageExtBrokerInnerTest

* fix codestyle

* fix codestyle

---------

Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
 2023-10-25 14:54:00 +08:00
lk f90c55341c [ISSUE #7497] Extract the frequency of calling updateNamesrvAddr into a configuration (#7498) 
merge
 2023-10-24 16:13:36 +08:00
rongtong 38d267672a Remove getBrokerClusterAclConfig from admin and server (#7486) 
* Remove getBrokerClusterAclConfig from admin and server

* Add @Deprecated annotation to GET_BROKER_CLUSTER_ACL_CONFIG request code
 2023-10-24 15:15:08 +08:00
Zhouxiang Zhan 2043dd5034 [ISSUE #7493] Introduce a new event NettyEventType.ACTIVE (#7494) 
* [ISSUE #7493] Introduce a new event NettyEventType.ACTIVE for ChannelEventListener

* introduce a new event NettyEventType.ACTIVE,

* implement channelActive interface for NettyRemotingClient#NettyConnectManageHandler

* add onChannelActive for ChannelEventListener interface.

* Move send heartbeat to onChannelActive
 2023-10-24 10:29:43 +08:00
Ao Qiao 8f020b397a [ISSUE #7489] Code comment enhancement in example (#7490) 
* Doc: How to debug in Idea

* en

* enhance code comment
 2023-10-23 16:34:10 +08:00
weihubeats 3968c186a5 [ISSUE #7231] Fix: proxy client language error (#7200) 
* Adding null does not update

* add langeuga code

* add langeuga code

* add langeuga code

* add langeuga code

* add langeuga code

* Rerun ci

* Rerun ci

* Rerun ci

* remove redundant package imports

* redundant line

* modify the parameter passed as proxyContext to language

* format
 2023-10-20 14:49:00 +08:00
Ji Juntao dbc633d92b Check the input yaml and the path in ACL (#7475) 
* check the input yaml and the path.

* only modify the path, no yaml.

* remove useless import
 2023-10-19 14:12:33 +08:00
guyinyouguyinyouRongtongJin
 		f0f15b5e21 [ISSUE #7454] Utilizing cache to avoid duplicate parsing (#7455) 
* Utilizing cache to avoid duplicate parsing

* add a method argument to decide cacheable

* Renaming variable names from cacheAble to isCached

---------

Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
Co-authored-by: RongtongJin <jinrongtong16@mails.ucas.ac.cn>
 2023-10-19 10:14:29 +08:00
rongtong 82b2f8eefa AddBroker removes parsing configuration from body (#7472) 2023-10-18 13:51:47 +08:00
Zhouxiang Zhan d73b601382 [ISSUE #7330] Fix channel connect issue for goaway (#7467) 
* add waitChannelFuture for goaway

* add body for retry channel
 2023-10-16 19:06:40 +08:00
Ao Qiao 3a035d75d7 [ISSUE #7464] Polish the pop logger format (#7465) 
* Doc: How to debug in Idea

* en

* polish

* polish log
 2023-10-16 15:56:48 +08:00
Ao Qiao 0f01df460f [ISSUE 7265] Doc: Adding how to debug in Idea document (#7266) 2023-10-16 11:37:25 +08:00
fujian-zfjandRongtongJin f565654351 [ISSUE #7064] [RIP-66-2] Support KV(RocksDB) Storage for ConsumeQueue (#7120) 
* typo int readme[ecosystem]

* consumequue support rocksdb

* fix rocksdb test

* fix rocksdb test

* remove unused method

* split into two tables

* CqUnit in Rocksdb [phyOffset, bodySize, tagHashCode, msgStoreTime]

* fix build.baze in tieredMessageStore

* skip RocksDBMessageStoreTest bazel

* skip RocksDBMessageStoreTest bazel

* Rocksdb TimerMessageStore

* fix unit test bazel

* fix store build.bazel

* fix store build.bazel

* optimize

* optimize

* polish

* build bytebuffer pair inner

* remove unused code

* DataConverter.CHARSET_UTF8

* fix comment

* fix comment

* rebuild test

* rebuild test

* optimize

* rebuild test

* polish

* polish

* rebuild test

* merge develop

* rebuild test

* rebuild test

* fix getConsumeQueue not find cq

* fix test

* rocksdb new version

* rebuild test

* fix bug

* Resolve conflicts after merging develop

* fix updateCqOffset

* fix recoverAbnormally

* fix recoverAbnormally

* polish

* polish

* polish

* remove exception in cleanunusedTopic

* remove exception in cleanunusedTopic

* remove exception in cleanunusedTopic

---------

Co-authored-by: RongtongJin <jinrongtong16@mails.ucas.ac.cn>
 2023-10-14 11:04:04 +08:00
guyinyou 2113fa371b [ISSUE #7453] Fix the problem in constructing the GetMessageResult (#7456) 
* Fix the problem in constructing the GetMessageResult

* Optimize the initialization size of GetMessageResult
 2023-10-13 13:47:09 +08:00
LetLetMe dc62d7f2e1 [ISSUE #7451] Override toString for TopicConfigAndQueueMapping 2023-10-13 13:45:48 +08:00
Lei Sun 28427d4012 [ISSUE #7425] Add RoccketmqControllerConsole log to fix bug (#7458) 2023-10-13 13:42:27 +08:00
rongtong 5d492c3382 [ISSUE #7444] Fix testCalculateFileSizeInPath test can not rerun in same environment (#7445) 
* Fix testCalculateFileSizeInPath test can not rerun in same environment

* Ensure that files are always deleted
 2023-10-13 11:23:30 +08:00
fujian-zfj 7e4879a3bc [ISSUE #7441] Fix log "Init the confirmOffset" keep printing error in controller mode (#7442) 
* typo int readme[ecosystem]

* fix keep printing log problem
 2023-10-11 14:45:07 +08:00
LetLetMeandLetLetMe dc3f22ffe9 add getter for class Message ,fix json serialize bug (#7439) 
Co-authored-by: LetLetMe <allen.hyt@alibaba-inc.com>
 2023-10-10 17:39:23 +08:00
Zhouxiang Zhan 4acb43ecee [ISSUE #7330] Add goaway and reconnection mechanism (#7331) 
* Add shutdown wait for NettyRemotingServer

* Add goaway and reconnection mechanism

* Add client version check

* Add enableTransparentRetry for NettyClientConfig

* Add enableReconnectForGoAway for NettyClientConfig

* fix unit test

* fix client version check
 2023-10-10 13:54:01 +08:00
mxsm 38d3d5d95d [ISSUE #7433]Update the version in the README.md document to 5.1.4 (#7434) 2023-10-10 09:37:04 +08:00
rongtong b18e564add [ISSUE #7431] Fix flaky test of DLedgerControllerTest#testBrokerLifecycleListener (#7432) 
* Fix flaky test of DLedgerControllerTest#testBrokerLifecycleListener
 2023-10-09 21:43:01 +08:00
redlsz 0027a1486d [ISSUE #7412] Fix pop revive message error when reput checkpoint 2023-10-09 16:52:10 +08:00
lk 3808387e13 [ISSUE #7429] clean channel map when CLIENT_UNREGISTER in proxy 2023-10-09 16:07:56 +08:00
Zhouxiang Zhan b9ffe0f957 [ISSUE #7296] Add ChannelEventListener for MQClientAPIImpl (#7324) 
* Add ChannelEventListener for MQClientAPIImpl

* add heartbeat when channel connect

* remove log

* Add enableHeartbeatChannelEventListener for ClientConfig
 2023-10-08 16:33:44 +08:00
Zhouxiang Zhan 84156084a4 [ISSUE #7321] Refector NettyRemotingAbstract with unify future implementation (#7322) 
* Refector NettyRemotingAbstract

* Add invoke with future method

* Deprecate InvokeCallback#operationComplete

* Add operationSuccess and operationException for InvokeCallback

* fix unit test

* fix unit test

* Keep InvokeCallback#operationComplete

* Optimize invokeAsyncImpl operationComplete

* Add unit test for NettyRemotingClient

* fix checkstyle
 2023-10-08 11:13:25 +08:00
shriVATSA54 c36bb78e85 [ISSUE 7313] Enhancement Optimization Method name (#7420) 
* Enhancment/method_name/#7313/

* Enhancment/method_name/#7313/

* Enhancment/method_name/#7313/
 2023-10-07 14:52:39 +08:00
ShuangxiDingand徒钟 4f1b42a7c5 [ISSUE #7410] Handle the Exception when the Proxy requests the client 
Co-authored-by: 徒钟 <shuangxi.dsx@alibaba-inc.com>
 2023-09-28 16:52:02 +08:00
tiger lee 0a6ae4605f [ISSUE #7396] Fix wrong word in BrokerController#doResterBrokerAll (#7397) 2023-09-27 14:43:15 +08:00
石臻臻(Steven shi)and石臻臻 959a98120c [ISSUE #7400] Fix getBrokerEpochSubCommand NPE 
Co-authored-by: 石臻臻 <shirenchuang.src@cainiao.com>
 2023-09-27 01:59:58 +08:00
石臻臻(Steven shi)and石臻臻 c3b86cd1e3 [ISSUE #7398] Fix ExportConfigsCommand NPE (#7399) 
Co-authored-by: 石臻臻 <shirenchuang.src@cainiao.com>
 2023-09-26 16:07:13 +08:00
Zhouxiang Zhan 3fd43353fd [ISSUE #7393] Add timeout configuration for grpc server (#7394) 
* Add timeout configuration for grpc server

* Add proxyConfig
 2023-09-26 13:53:51 +08:00
guyinyouandguyinyou d7e5c4d1a4 [ISSUE #7389] Fix the problem that getLastMappedFile function affects performance 
Co-authored-by: guyinyou <guyinyou.gyy@alibaba-inc.com>
 2023-09-25 13:37:36 +08:00
Ji Juntao 88a9d939ce [ISSUE #7381] Fix the problem of inaccurate timer message metric (#7382) 
* correct the timerMetrics' result.

* for further extension.

* checkstyle.

* use toLong.
 2023-09-23 17:38:27 +08:00
lk 73b3fde837 [maven-release-plugin] prepare for next development iteration (#7379) 2023-09-22 10:08:59 +08:00
lk 1a681bdf9b [maven-release-plugin] prepare release rocketmq-all-5.1.4 (#7377) rocketmq-all-5.1.4 2023-09-21 19:58:29 +08:00
Jixiang Jin b8610d87bb Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter. (#7373) 
* Replace loggingMetricExporter with OtlpJsonLoggingMetricExporter.

* Fix bazel workspace

* Move OtlpJsonLoggingMetricExporter to proxy and controller.

* Fix Bazel imports.
 2023-09-21 16:21:44 +08:00