Commit Graph
279 Commits
Author SHA1 Message Date
zhangyang 97198fadf6 [ISSUE #3449] Delayed message supports asynchronous delivery (#3458)
* [schedule] Delayed message repeated delivery optimization

Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>

* [schedule] Support asynchronous delivery

Signed-off-by: zhangyang <Git_Yang@163.com>

* use maxDelayLevel as deliverThreadPoolNums

Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>

* [HAConnection] fix code style

Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>
2022-01-20 22:22:43 +08:00
makabakaboom 84cde5f5be #3015 when slaveAckOffset greater than local commitLog offset, break connection and return (#3016)
when slaveAckOffset greater than local commitLog offset, break connection and return
2022-01-20 13:37:01 +08:00
tianliuliu 14b63ee550 [RIP-28] light message queue(LMQ) (#3694) 2022-01-13 19:15:42 +08:00
Kealdish acac49f148 [ISSUE #3738] Remove useless callee of String.valueOf (#3739) 2022-01-10 09:59:39 +08:00
rongtong 938e201d1a [ISSUE #3733] Upgrade dledger version to 0.2.3 (#3734) 2022-01-08 20:11:33 +08:00
huangli 6d247cb3c6 [ISSUE 3585] [Part J] Use MappedByteBuffer instead of FileChannel to write consume queue and slave commitlog. (#3657)
This commit improve reput performance and speed up consume qps greatly. In our test, produce about 200,000 tps.
72 queue consume qps: from about 70,000 to 200,000
600 queue consume qps: from about 70,000 to 110,000
2021-12-27 20:02:57 +08:00
cnScarb f1b2c4f360 Fix spelling error in DefaultMessageStore, use getServiceName for GroupCommitService logging (#3663) 2021-12-23 14:26:50 +08:00
张旭andzhangxu16 f620a50bc7 [ISSUE #2383] Export putMessageFailedTimes with broker status (#2385)
Co-authored-by: zhangxu16 <zhangxu16@xiaomi.com>
2021-12-20 22:34:08 +08:00
huangli 5081d155f8 [ISSUE #3637] Add enableDetailStat in BrokerConfig so we can disable stat of queue level. (#3638)
[ISSUE #3637] Add enableDetailStat in BrokerConfig so we can disable stat of queue level.
2021-12-15 20:03:23 +08:00
zhaohai 5fea69bd39 [ISSUE #3644] exchange parameters 2021-12-15 17:32:24 +08:00
haozhijie9527andhaozhijie 7d1b001c2f fix npe of SendMessageProcessorTest (#3632)
Co-authored-by: haozhijie <“haozhijie_9527@163.com”>
2021-12-13 11:14:59 +08:00
haozhijie9527andhaozhijie dcbf276e91 [ISSUE 3585] [Part I] Avoid unnecessary StringBuffer resizing and String Formatting (#3619)
Co-authored-by: haozhijie <haozhijie_9527@163.com>
2021-12-10 22:03:08 +08:00
codingandzanglei f395fa6837 [ISSUE #3601] Fix dledger put batch msg stats bug (#3600)
Co-authored-by: zanglei <zanglei@kuaishou.com>
2021-12-08 17:14:26 +08:00
tianliuliu b5a8334e8a [ISSUE #3604] Some important interface methods add comment 2021-12-08 16:21:39 +08:00
zhaohaiandzh378814 a779d69862 Unnecessary boxing of primitives (#3596)
Co-authored-by: zh378814 <wb-zh378814@alibaba-inc.com>
2021-12-07 12:35:43 +08:00
huangli 83accb6f12 [Issue #3476] Fix last separator of properties string is missing when using batch send. (#3479)
This problem introduced since 4.9.1, may cause tag incorrect.
2021-12-07 11:42:43 +08:00
彭小漪 5d5d5f5f4c optimizing: For a big set, replace sequential iteration addition with a parallel stream when calculating results. (#3540)
refactor: Renaming variables lockXXX to xxxLock may be better.
2021-12-02 15:52:30 +08:00
Git_Yang b35f3e4459 [ISSUE #3286] Replace Timer with ScheduledExecutorService (#3287)
Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>
2021-11-10 19:43:42 +08:00
Git_Yang 2d9a7e1215 [ISSUE #3463] Fix the issue of commitLog path error (#3464) 2021-11-10 19:39:25 +08:00
JiangHaitingandJiang Haiting 7b05208618 [ISSUE #3467] Fail fast on loading files with error mappedFileSize
Co-authored-by: Jiang Haiting <jianghaiting@didichuxing.com>
2021-11-08 10:27:01 +08:00
zhichen c6aeb782e5 [ISSUE #3459] Fix the problem of Put messages to commitLog always failure after encountering any exception (#3460) 2021-11-04 17:18:05 +08:00
tigerlee 21faa68b4c [maven-release-plugin] prepare for next development iteration 2021-10-22 13:44:14 +08:00
tigerlee c840b20833 [maven-release-plugin] prepare release rocketmq-all-4.9.2 2021-10-22 13:43:57 +08:00
Git_Yang b30bd87054 [ISSUE #2667] Repair 'file doesn't exist on this path'
Signed-off-by: zhangyang <Git_Yang@163.com>
2021-09-27 08:50:30 +08:00
WJL3333 d429aa24d3 [ISSUE #3375] Lazy init GetMessageResult only when find message 2021-09-26 18:47:27 +08:00
tiger lee 4dbdbf0a25 Merge pull request #3357 from Jason918/RIP-7
RIP-7 Multiple Directories Storage Support
2021-09-25 22:47:22 +08:00
rongtong 538b6b7ffd [ISSUE #1869] Delay message can't be consumed when delay offset in delayOffset.json is wrong (#3358)
* fix(store):delay message can't be consumed when delay offset is wrong

* fix(store):delay message can't be consumed when delay offset is wrong

* fix(common):pass the code style

* fix(store): fix bug of get cq max offset

* fix(store): polish the code

* fix(store): fix bug to pass the UT test

* chore(store): polish log format

* chore(store): polish code style
2021-09-24 17:55:02 +08:00
Jiang Haiting 14d50f9808 fix a typo 2021-09-23 13:56:28 +08:00
Jiang Haiting 7d4e5cd659 fix compile error 2021-09-22 19:48:27 +08:00
Jiang Haiting 474c4eb147 Fix bug for multi path file loading. Opt code checking for multi-path commitlog path in storePathCommitLog. 2021-09-22 19:46:12 +08:00
Jiang Haiting f32406d68a change default value of org.apache.rocketmq.store.config.MessageStoreConfig#MULTI_PATH_SPLITTER to ',' and can be changed by System.getProperty("rocketmq.broker.multiPathSplitter") 2021-09-21 18:17:15 +08:00
Jiang Haiting 255a202817 add path empty check to avoid error log in org.apache.rocketmq.store.DefaultMessageStore#getRuntimeInfo 2021-09-18 16:45:28 +08:00
Jiang Haiting 466bb98eef fix error in org.apache.rocketmq.store.DefaultMessageStore.CleanCommitLogService#isSpaceFull 2021-09-17 11:16:28 +08:00
Jiang Haiting 9b0e31e469 1. fix initial value of physicRatio in org.apache.rocketmq.broker.processor.SendMessageProcessor#diskUtil
2. use minPhysicsUsedRatio instead of max in org.apache.rocketmq.store.DefaultMessageStore#getRuntimeInfo
2021-09-16 11:04:25 +08:00
Jiang Haiting 8e19069c98 fix test error 2021-09-16 10:55:14 +08:00
Jiang Haiting a9a7dfa722 RIP-7 Multiple Directories Storage Suppor 2021-09-15 22:36:34 +08:00
huangli 311d76f9c8 [ISSUE 3194] [PART C] Replace AtomicLong with LongAdder in StatsItem.java to improve performance (#3351) 2021-09-14 23:48:15 +08:00
Git_Yang 564ee290c7 [ISSUE] Add get stats and single queue stats for schedule topic
Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>
2021-09-12 10:17:38 +08:00
huangli d7a830cf8f [ISSUE 3194] [PART A] Use LongAdder instead of AtomicLong in BrokerStatsService to improve performance. (#3195) 2021-09-06 20:16:11 +08:00
gorden5566 44bdeedad2 [ISSUE 3203] Replace the class 'StringBuffer' by 'StringBuilder' (#3204) 2021-08-04 14:02:47 +08:00
zongtanghu bb34171289 [maven-release-plugin] prepare for next development iteration 2021-08-01 20:01:59 +08:00
zongtanghu e9c4253218 [maven-release-plugin] prepare release rocketmq-all-4.9.1 2021-08-01 20:01:39 +08:00
Heng Du 2509b0edc5 Merge pull request #2961 from areyouok/dev_speed_F
[ISSUE #2883] [Part F] Improve produce performance in M/S mode.
2021-07-31 00:30:57 +08:00
huangli a23df96790 [ISSUE 2883] Improve performance of string2messageProperties/messageProperties2String, and save 1 byte for each message. 2021-07-30 20:27:46 +08:00
huangli 032577255e [ISSUE #2883] [Part E] Improve produce performance in M/S mode. (#2889)
* Remove putMessage/putMessages method in CommitLog which has too many duplicated code.

* Optimise performance of asyncPutMessage (extract some code out of putMessage lock)

* extract generation of msgId out of lock in CommitLog (now only for single message processor)

* extract generation of topicQueueTable key out of sync code

* extract generation of msgId out of lock in CommitLog (for batch)

* fix ipv6 problem introduced in commit "Optimise performance of asyncPutMessage (extract some code out of putMessage lock)"
2021-07-28 14:49:45 +08:00
Heng Du 765cac3d9d Merge pull request #3025 from Git-Yang/statistics_bug
[ISSUE #3023] Fix the inconsistency of putMessageDistributeTime statistics
2021-07-21 09:14:18 +08:00
xiaoyaofawai 589e87c278 [ISSUE #3099] Fix the incorrect judegment 'writePos - lastCommittedPosition > commitLeastPages' in the method 'commit0' of class 'MappedFile' (#3125) 2021-07-09 13:40:02 +08:00
francis lee 2fc1148b9a Merge pull request #3111 from codersfarm/develop
[ISSUE #3110]Fix: remove useless code
2021-07-09 09:53:07 +08:00
huangli 3183122c01 Eliminate array copy (#2886)
[Part C] Improve produce performance in M/S mode.
2021-07-06 21:47:12 +08:00
huangli d65778f3a8 [ISSUE #2883] [Part B] Improve produce performance in M/S mode. (#2885)
* Optimise lock in WaitNotifyObject

* Remove lock in HAService

* Remove lock in GroupCommitService
2021-07-06 21:46:14 +08:00