Commit Graph
2062 Commits
Author SHA1 Message Date
RongtongJin a17fa7605c [maven-release-plugin] prepare release rocketmq-all-5.0.0-ALPHA rocketmq-all-5.0.0-ALPHA 2022-03-11 10:37:19 +08:00
RongtongJin ee8decdc77 Prepare to release rocketmq 5.0.0-alpha 2022-03-10 22:46:11 +08:00
RongtongJin 5247985e34 Fix missing ASF header in plain_acl.yml 2022-03-04 20:23:12 +08:00
RongtongJin e33213c752 Upgrade version to 5.0.0-alpha-snapshot 2022-03-04 16:44:03 +08:00
RongtongJin 87d9614d34 Resolve all conflicts and pass all UTs 2022-03-04 16:38:04 +08:00
RongtongJin 0d15e6c2d5 Merge 5.0.0-alpha-merge with develop branch 2022-02-25 17:43:06 +08:00
tigerlee 13933297d1 [maven-release-plugin] prepare for next development iteration 2022-02-21 21:33:20 +08:00
tigerlee 666e96b6dd [maven-release-plugin] prepare release rocketmq-all-4.9.3 2022-02-21 21:33:02 +08:00
Rishi Kumar Ray 2369a9152d depreciated unused class (#3846)
* depreciated MQhelper

* Update MQHelper.java
2022-02-20 15:32:20 +08:00
sunxi92 c1bb6aa27b [ISSUE #2986] Support for multiple ACL files in a fixed directory (#3761)
* acl temp

* acl

* fix test case

* fix code style issues

* add considerations on compatibility to the original one ACL config file and scalability of supporting multiple config files in different directories.

* fix test case testWatch

* 1.fix some issues
2.add a detailed design document

* Add warn log when the accesskey is repeated in multiple ACL files.

* 1.Change the folder of acl configuration to conf/acl
2.Add the logic to check if path is a directory in the method of getAllAclFiles(String path)

* Add a parameter in AclFileWatchService constructor.

* Add logic to determine if path exists in the getAllAclFiles(String path) method in PlainPermissionManager.java and AclFileWatchService.java

* Fix the serialization problem of allAclFileVersion field in clusterAclConfigVersion command

* 1.Fix the serialization problem of allAclFileVersion field in clusterAclConfigVersion command
2.Improve the logic of updateAccessConfig method
2022-02-19 09:52:31 +08:00
fef8670662 [ISSUE #3863] Updated Notice file to 2022 (#3864)
* Update .travis.yml

Depracated MODERATE noisy mail for dev@rocketmq.apache.org. Still Failing: apache/rocketmq#5670 (5.0.0-alpha-static-topic - 5ebc327) @dongeforever

* Updated Notice file to 2022 (#3735)

* Updated Notice file to 2022

Co-authored-by: von gosling <vongosling@apache.org>
Co-authored-by: ZhangJian He <shoothzj@gmail.com>
2022-02-19 09:48:15 +08:00
HuiTong cc478bd425 fix scheduleAtFixedRate bug (#3861) 2022-02-18 23:26:12 +08:00
写代码的猫andhuangli 7428d6520b [ISSUE #3827]Improve Performance of transactional message and schedule message (#3828)
* [ISSUE #3827] Part 1. Add Slave Timeout config
* [ISSUE #3827] Part 2. Improve Performance of Transactional Message and Delay Message Scheduling

Co-authored-by: huangli <areyouok@gmail.com>
2022-02-17 14:00:21 +08:00
Ni Ze fc014049a2 fix(log) add log for interruptedException (#3854) 2022-02-17 13:27:09 +08:00
Heng Du a45c7bc60e [ISSUE #3852]Move the Logappender module to external (#3851)
* feat(logappender) move logappender to external(https://lists.apache.org/thread/938sjby3hnnzcttpp20p17ywhc0rgr8s)

* remove logappender module
2022-02-16 10:45:38 +08:00
Martin Grigorov 459b9d0be8 Re-enable testing on ARM64 (#3850)
* Re-enable testing on ARM64

But this time on:
1) AWS Graviton2 machines - they are more reliable
2) Ubuntu 20.04 - it is better maintained by Travis team

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

* Run `mvn verify` in batch mode and do not log network transfer progress

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

* Do not use -ntp (--no-transfer-progress)

Because it is not available in Maven 3.6.0 (latest available in Ubuntu 18.04)

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>
2022-02-16 08:52:13 +08:00
cserwen de76e06d6d add hook to execute after consume for pop (#3780) 2022-02-14 15:11:06 +08:00
yuz10 48e8c1955b add tests for computePullFromWhereWithException (#3844) 2022-02-13 10:02:40 +08:00
zhangjidi2016andzhangjidi 8b78f6114f [ISSUE #3674]Add unit test for AllocateMessageQueueAveragelyByCircle (#3839)
Co-authored-by: zhangjidi <zhangjidi@cmss.chinamobile.com>
2022-02-11 11:30:07 +08:00
Aaron-TangCodeandtanghailin 4992f4ee9c [ISSUE ##3832] in order to improve the performance by change the variable location of queueId (#3833)
* change variable queueId location

* [fix]the wildcard

Co-authored-by: tanghailin <tanghailin@58.com>
2022-02-10 11:43:43 +08:00
huangli 8fa9ca592c [ISSUE 3825] Use default SO_SNDBUF/SO_RCVBUF/WRITE_BUFFER_WATER_MARK value. (#3826)
This commit may greatly increase thoughtput when network lantency is big or message size is big, especially for consumer.

In one broker (M/S sync master async flush), one producer send test.

250 byte body: 0.93x old version
4000 byte body: 3.85x of old version
16000 byte body: 6.07x of old version
100000 byte body: 7.93x of old version

The old version is 4.9.3-SNAPSHOT in this test. In this test the network latency from producer to broker is 1.61ms.
2022-02-10 11:15:04 +08:00
ca92d367fd Update design.md (#3835)
* Update .travis.yml

Depracated MODERATE noisy mail for dev@rocketmq.apache.org. Still Failing: apache/rocketmq#5670 (5.0.0-alpha-static-topic - 5ebc327) @dongeforever

* Updated Notice file to 2022 (#3735)

* Update design.md

delete redundant text

Co-authored-by: von gosling <vongosling@apache.org>
Co-authored-by: ZhangJian He <shoothzj@gmail.com>
2022-02-09 19:08:43 +08:00
Hongjian Fei 631405e2fb [ISSUE #3741] Use wait-until-${async-complete}-reaches DSL instead of sleep(n) to to reduce invalid wait time. (#3829) 2022-02-09 11:20:50 +08:00
KviciiandKvicii 810b75766b [ISSUE #3797] Improve DefaultMQProducerImpl code (#3809)
* improve DefaultMQProducerImpl code

* revert change

Co-authored-by: Kvicii <Karonazaba@gmail.com>
2022-02-08 17:54:07 +08:00
zhangyang21 0b4adb49b4 [Assignment] Fix the risk of memory overflow caused by excessive popShareQueueNum.
Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>
2022-02-08 10:38:41 +08:00
cserwen 5d15c3ed17 change the level to warn when the ack message failed (#3756) 2022-02-08 10:38:41 +08:00
cserwen fe88fb36a3 [ISSUE #3498] Make messages in reviveTopic more evenly written to different queues #3499 2022-02-08 10:38:41 +08:00
Hongjian Fei 78a3ed7b0e [ISSUE #3708] add CorrectLogicOffsetService to periodically correct min logic offset (#3722)
* [ISSUE #3708] add CorrectLogicOffsetService to periodically correct min logic offset; refactor QueueOffsetAssigner.

* Mock getDiskSpaceWarningLevelRatio and getDiskSpaceCleanForciblyRatio to get around configuration protection in unit-test.

* Fix check style.
2022-02-08 10:38:41 +08:00
Hongjian Fei 6172ad3713 [ISSUE #3708] Refactor CQ and BCQ loading process and Fix some unit-tests issue. (#3713)
* [RIP-26] Both CQ and BCQ will be supported in DefaultMessageStore.

* [RIP-26] Both CQ and BCQ will be supported in DefaultMessageStore.

* Part of ISSUE #3708. Refactor CQ and BCQ loading process.

* Mock getDiskSpaceWarningLevelRatio and getDiskSpaceCleanForciblyRatio for ut.

* Optimize batch message unit-test.

* Mock getDiskSpaceWarningLevelRatio and getDiskSpaceCleanForciblyRatio for ut.

* Optimize batch message unit-test.
2022-02-08 10:38:41 +08:00
Hongjian Fei e8cf133874 [ISSUE #3708] Both CQ and BCQ need to be supported in DefaultMessageStore. (#3712)
* [RIP-26] Both CQ and BCQ will be supported in DefaultMessageStore.

* [RIP-26] Both CQ and BCQ will be supported in DefaultMessageStore.
2022-02-08 10:38:41 +08:00
cserwen 5ce1b88cf0 fix check style (#3703) 2022-02-08 10:38:41 +08:00
dongeforever 372e42ff45 Fix check style 2022-02-08 10:38:41 +08:00
dongeforever a767cc1424 Fix test for consumer offset 2022-02-08 10:38:41 +08:00
dongeforever b3f9fbd3a7 Convert the consumer offset too 2022-02-08 10:38:41 +08:00
Hongjian Fei 18010a4d30 [ISSUE #3679] Support topic attributes (#3698)
* [Feature] Support topic attributes.

* [Feature] Topic attributes unit-test.
2022-02-08 10:38:41 +08:00
zhangyang21 8bb98c9f41 [acl] Modify unit test to solve the problem of lack of license
Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>
2022-02-08 10:38:41 +08:00
zhangyang21 c998f3fe68 [benchmark] Add clientRebalanceEnable
Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>
2022-02-08 10:38:41 +08:00
zhangyang21 a01433094b [tools] Fix parameter conflicts
Signed-off-by: zhangyang21 <zhangyang21@xiaomi.com>
2022-02-08 10:38:41 +08:00
hill007299 6ba93446b3 [RIP-19] Pop Consuming (tools)
Conflicts:
	tools/src/main/java/org/apache/rocketmq/tools/admin/DefaultMQAdminExt.java
	tools/src/main/java/org/apache/rocketmq/tools/admin/MQAdminExt.java
	tools/src/main/java/org/apache/rocketmq/tools/command/MQAdminStartup.java
2022-02-08 10:38:41 +08:00
Erik1288 821b91f0a2 support batch consume-queue. 2022-02-08 10:38:41 +08:00
dongeforever b6ff649291 feat(all):new feature for static topic 2022-02-08 10:38:41 +08:00
yuz10 d5c8800125 add tests for AllocateMessageQueueAveragely (#3811) 2022-02-07 23:51:02 +08:00
PJ Fanning dbbc88a6fe guava 31.0.1-jre (#3821)
https://github.com/apache/rocketmq/issues/3818
2022-02-07 09:44:30 +08:00
PJ Fanning 32511145ae [Issue-3814] use snakeyaml 1.30 (#3815)
due to a CVE
2022-02-06 20:41:19 +08:00
PJ Fanning 32dd2d82c1 [Issue-3816] upgrade log4jv2 to 2.17.1 (#3817)
https://github.com/apache/rocketmq/issues/3816
2022-02-05 23:44:21 +08:00
Kvicii 7496081da6 fix ISSUE 2812 (#3813) 2022-02-05 16:56:14 +08:00
彭小漪 f219170851 [ISSUE #3786] fix: The length of properties value should be checked before converting them to short. (#3788) 2022-02-03 17:54:46 +08:00
彭小漪 d5be91fa00 [ISSUE #3789] optimize: Tag the name of consuming thread whith consumeGroup. (#3795)
* It is useful for debug.
2022-01-27 14:58:09 +08:00
彭小漪 30d1c58a0c [ISSUE #3801] Polish the document 'CLITools.md'. (#3802) 2022-01-27 14:29:32 +08:00
Xinda 8ce2cdb004 perf: avoid multiple expansion when the number of elements in the MessageConst class is determined (#3721)
`HashSet`, threshold = initialCapacity * 0.75
2022-01-26 10:44:01 +08:00