Commit Graph
548 Commits
Author SHA1 Message Date
hzh0425 2cc899fc35 [ISSUE #5663] Fix Messages may be lost when SyncStateSet expand in extreme scenarios (#5798)
* Add a new state 'isSynchronizingSyncStateSet' to Solve the problem of missing messages

* pass checkstyle

* Using readWriteLock to replace synchronized in AutoSwitchHAService

* Fix lock issue

* Remove unnecessary 'remoteSyncStateSet.clear'

* optimize import
2023-03-13 14:22:29 +08:00
rongtong 20dc5c96ea [ISSUE #6316] Nameserver should choose a master with a larger epoch when there are two masters in controller mode (#6317) 2023-03-13 11:16:35 +08:00
fujian-zfj 7b23042eb2 [ISSUE #6306] Fix unexpected state from slave (#6307)
* typo int readme[ecosystem]

* fix unexpected state from slave
2023-03-10 13:39:28 +08:00
rongtong ba4dd5a21e [ISSUE #6283] Fix the bug that single replica cannot flush data when transientStorePoolEnable is true
[ISSUE #6283] Fix the bug that single replica cannot flush data when transientStorePoolEnable is true
2023-03-09 11:43:38 +08:00
rongtong 9e0fb1b029 [ISSUE #6169] Fix NPE when timerWheel disabled (#6184)
* Fix some NPE when timerWheel disabled

* Add UT
2023-03-08 17:23:06 +08:00
cc8823cf62 [ISSUE #5883] DLedger commit log should override the getData (#5879)
* fix: dledger commit log should override the getData

Change-Id: I665c5b9d7e96c5b7ccd035b32272be7223d7f454

* fix: adjust timer test case for dledger

* test: remove some test case to speed up unit test

Change-Id: I5aa348ab17977ce1f0e080f7801b28797ef82af9

* test: remove other timer dledger test

* Revert TimerMessageStoreTest

---------

Co-authored-by: liwen.2022 <liwen.2022@bytedance.com>
Co-authored-by: RongtongJin <jinrongtong16@mails.ucas.ac.cn>
2023-03-06 09:20:41 +08:00
TheR1sing3un 18fcce664c [ISSUE #6250] Fix wrong value of MessageStoreConfig#storePathEpochFile
1. fix wrong value of MessageStoreConfig#storePathEpochFile
2023-03-05 21:57:24 +08:00
hardyfish ce99a7fe8a [ISSUE #6246] Optimize AcceptSocketService#run 2023-03-05 11:21:44 +08:00
rongtong d5d5a637f6 [ISSUE #6226] Shutdown flowMonitor when connection disconnect (#6227)
* Shutdown flowMonitor when connection disconnect

* Whether the master is existed has more accurate judgment

* Shutdown flowMonitor when HAClient service end

* Pass the check style

* Modify according to comments
2023-03-03 22:28:15 +08:00
TheR1sing3un 487473eb74 [ISSUE #6121] Optimize some code style in store module (#6122)
* style(store): optimize some typos in store module

1. optimize some typos in store module

* style(store): rename DefaultHAClient#REPORT_HEADER to DefaultHAClient#REPORT_HEADER_SIZE

1. rename DefaultHAClient#REPORT_HEADER to
DefaultHAClient#REPORT_HEADER_SIZE

* style(store): optimize comment about DefaultHAClient#REPORT_HEADER_SIZE and DefaultHAConnection#TRANSFER_HEADER_SIZE

1. optimize comment about DefaultHAClient#REPORT_HEADER_SIZE and
DefaultHAConnection#TRANSFER_HEADER_SIZE
2023-02-27 11:40:20 +08:00
zhouxiang 0f878b5157 [maven-release-plugin] prepare for next development iteration 2023-02-16 12:35:58 +08:00
zhouxiang b8e9334d2a [maven-release-plugin] prepare release rocketmq-all-5.1.0 2023-02-16 12:35:58 +08:00
zhouxiang 83d6778747 [ISSUE #6030] Update version to 5.1.0-SNAPSHOT 2023-02-16 12:35:58 +08:00
nowinkey 7d58f68819 Modify abbreviated variables and add comments 2023-02-14 13:50:47 +08:00
nowinkey 07e65d37d0 Put batchDispatchRequestThreadPoolNums config to MessageStoreConfig.java 2023-02-14 13:50:47 +08:00
nowinkey ee6cddfdb2 Combine the process of decoding byteBuffer into preCheckMessageAndReturnSize method 2023-02-14 13:50:47 +08:00
nowinkey c2ea0922b7 Remove enableBuildConsumeQueueConcurrently attribute from BrokerConfig class 2023-02-14 13:50:47 +08:00
nowinkey dcf84e4125 Add integration test and add enableBuildConsumeQueueConcurrently attribute to BrokerConfig class 2023-02-14 13:50:47 +08:00
nowinkey 64dbc26950 Add case MESSAGE_MAGIC_CODE_V2 2023-02-14 13:50:47 +08:00
nowinkey d2a4b70476 Change the permission modifier of reputFromOffset from public to protected 2023-02-14 13:50:47 +08:00
nowinkey 2af52a5dbd Delete redundant method run() 2023-02-14 13:50:47 +08:00
nowinkey e5c19647ad Fix codeStyle issue 2023-02-14 13:50:47 +08:00
nowinkey 65e3d1e4c0 Add try catch 2023-02-14 13:50:47 +08:00
nowinkey 04b8400eb9 Refactor MainBatchDispatchRequestService and DispatchService service object locations 2023-02-14 13:50:47 +08:00
nowinkey 87c0a03162 Refactor LOGGER.warn() 2023-02-14 13:50:47 +08:00
nowinkey d211e8664d Change the reject policy to AbortPolicy and add try catch final protect 2023-02-14 13:50:47 +08:00
nowinkey 8bf81c4684 Set a custom reject policy for batchDispatchRequestExecutor 2023-02-14 13:50:47 +08:00
nowinkey 8a3c7ffde4 Fixed the infinite loop bug and useless import 2023-02-14 13:50:47 +08:00
nowinkey b92a29e135 Create ConcurrentReputMessageService and replace native thread with ServiceThread 2023-02-14 13:50:47 +08:00
nowinkey 144254a5c4 [ISSUE #5884] Concurrent check CommitLog messages 2023-02-14 13:50:47 +08:00
lk 3ac1977c78 [ISSUE #6012] change the type of queueId to int of PopCheckPoint (#6013) 2023-02-09 13:57:37 +08:00
SSpirits 9a55592409 [ISSUE #5994] [RIP-46] add pop and timer metrics (#5995)
* add pop and timer metrics
* fix according to review comment
2023-02-08 15:03:08 +08:00
Oliver 59f056d75a [ISSUE #5942] Fix the produce count include the quantity of the system topic(#5943) 2023-02-07 09:51:00 +08:00
Aaron Ai ff8c4c856d [ISSUE #5890] Fix dledger logging (#5959)
* Fix dledger logging

* Add bridge into store module
2023-02-03 14:12:23 +08:00
pingww 4628021588 [ISSUE #5965] Fix lmqTopicQueueTable initialization (#5968)
* [ISSUE #5965] Fix lmqTopicQueueTable initialization

* [ISSUE #5965] Fix lmqTopicQueueTable initialization
2023-02-03 13:44:28 +08:00
rongtong ddfee4b4d8 Ignore testChangeRoleManyTimes in AutoSwitchHATest util it is stable (#5871) 2023-01-12 19:27:23 +08:00
mxsm dc902082bd [ISSUE #5804] Optimize BrokerStatsManager#incTopicPutLatency create statsKey (#5805) 2023-01-12 10:42:41 +08:00
Oliver 1d610ab973 [ISSUE #5832] Fix consumerCount increasing rapidly without sending message (#5834) 2023-01-10 21:03:37 +08:00
SSpirits 3949f6938e [ISSUE #5837] Deprecate MessageStore#checkInDiskByConsumeOffset (#5840)
* deprecate MessageStore#checkInDiskByConsumeOffset and add checkInMemByConsumeOffset and checkInStoreByConsumeOffset in MessageStore

* skip initializing isLoaded0 method in windows
2023-01-09 16:47:42 +08:00
SSpirits 268e9b9018 [ISSUE #5830] fix bug in GetMessageResult#getMessageCount (#5831)
* fix bug in GetMessageResult#getMessageCount

* add license

* fix codestyle
2023-01-06 10:44:47 +08:00
lizhiminsand斜阳 9b3b551a0f [ISSUE #5823] Fix delete topic in message store interface (#5828)
* [ISSUE #5823] Fix delete topic in message store interface

* [ISSUE #5823] Add delete topic test

Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
2023-01-05 18:39:43 +08:00
lizhiminsand斜阳 83c47dddc9 [ISSUE #5823] Add delete topic in message store interface (#5824)
Co-authored-by: 斜阳 <terrance.lzm@alibaba-inc.com>
2023-01-05 15:28:46 +08:00
mxsm 24c9a52c3a [ISSUE #5809] Replace synchronized with ReentrantReadWriteLock in AutoSwitchHAService (#5810) 2023-01-03 15:43:02 +08:00
mxsm d070d467a6 [ISSUE #5802]Optimize HashMap and HasSet invoke resize method (#5803) 2023-01-03 10:32:36 +08:00
rongtong e1dfc0db53 [ISSUE #5714] Fix the issue that broker can't work normally when transientStorePool=true in controller mode (#5722)
* Fix the issue that the slave role does not initialize the transientPool in controller mode

* Format the checkstyle

* Remove the useless import

* Fix the HA transmission disconnection issue when transientStorePoolEnable is true

* just test

* just test

* just test

* just test

* just test

* just test

* just test

* just test

* just test

* Format the check style

* Format the check style
2023-01-01 13:02:53 +08:00
Zhanhui Li 8e2ee23819 [ISSUE #5783] Fix compilation warning (#5784)
* Fix compilation warning

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

* Skip unstable test case HATest#testSemiSyncReplicaWhenSlaveActingMaster on macOS

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
2022-12-30 11:01:17 +08:00
SSpiritsandLi Zhanhui 9f8e85bb76 [ISSUE #5754] [RIP-57] Add asynchronous interfaces to MessageStore (#5755)
* [RIP-57] Add asynchronous interfaces to MessageStore

* fix unit test

* Modified according to review comments

* Remove unnecessary stubbing

* Add some other methods to MessageStore

* fix bazel test

* Skip failing test case

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>

Signed-off-by: Li Zhanhui <lizhanhui@gmail.com>
Co-authored-by: Li Zhanhui <lizhanhui@gmail.com>
2022-12-29 09:42:45 +08:00
SSpirits 81e3648e3f Introduce retry topic and lag estimation for lag calculation. (#5702) 2022-12-16 16:48:56 +08:00
mxsm 2f460855de [ISSUE #5668] Polish AutoSwitchHAClient and AutoSwitchHAConnection Comments (#5669) 2022-12-09 14:39:25 +08:00
mxsm aa02160074 [ISSUE #5651] Fix unable to send messages normally due to HA disconnection (#5667) 2022-12-09 11:23:31 +08:00