 xming521
|
247920fe00
|
更新.gitignore，更新pyproject.toml,添加pre-commit，更新README.md。
|
2025-06-09 11:26:14 +08:00 |
|
|
小铭
|
d41a806dc9
|
Merge pull request #148 from xming521/xming521-patch-8
Update README.md
|
2025-06-08 20:21:12 +08:00 |
|
|
小铭
|
3798fae701
|
Update README.md
|
2025-06-08 20:20:49 +08:00 |
|
|
小铭
|
bbd856dbb6
|
Merge pull request #147 from xming521/xming521-patch-7
Rename Telegram Release Notification to tg_release_notification.yml
v0.2.22-for-tg-notice
|
2025-06-08 12:08:39 +08:00 |
|
|
小铭
|
01a3ec4c24
|
Rename Telegram Release Notification to tg_release_notification.yml
|
2025-06-08 12:08:22 +08:00 |
|
|
小铭
|
474352b30f
|
Merge pull request #146 from xming521/xming521-patch-6
Create Telegram Release Notification
|
2025-06-08 12:05:21 +08:00 |
|
|
小铭
|
d16e9abf2e
|
Create Telegram Release Notification
|
2025-06-08 12:05:07 +08:00 |
|
|
小铭
|
dc09602864
|
Merge pull request #142 from xming521/dev
Support image modality chat history fine-tuning
v0.2.22
|
2025-06-06 21:39:44 +08:00 |
|
|
xming521
|
b5b661154d
|
更新README.md。
|
2025-06-06 21:38:32 +08:00 |
|
|
xming521
|
3842932cab
|
更新README.md；调整mllm模板中的训练参数。
|
2025-06-06 20:52:44 +08:00 |
|
|
xming521
|
cccd2fe87b
|
Update dependencies
v0.2.22-beta1
|
2025-06-03 23:05:09 +08:00 |
|
|
xming521
|
48f0ed3465
|
更新pyproject.toml，更新README.md。
|
2025-06-03 22:34:44 +08:00 |
|
|
xming521
|
8c20c1a689
|
更新pyproject.toml。
|
2025-06-03 21:31:59 +08:00 |
|
|
xming521
|
f7fc362dc6
|
更新README.md。
|
2025-06-03 19:46:50 +08:00 |
|
|
xming521
|
18af67104d
|
更新README.md；在cli.py中根据配置动态选择数据处理器。
|
2025-06-02 10:04:08 +08:00 |
|
|
xming521
|
2a868a1314
|
更新README.md
|
2025-06-01 22:57:55 +08:00 |
|
|
xming521
|
4a614800ca
|
修改wechat_parser.py以支持命令行参数传递微信个人文件夹路径并优化图片复制功能。
|
2025-06-01 20:22:23 +08:00 |
|
|
xming521
|
a703188a4e
|
Merge remote-tracking branch 'origin/master' into dev
|
2025-06-01 18:52:46 +08:00 |
|
|
xming521
|
1e52a20ef0
|
在mllm模板中添加enable_thinking配置项，默认为false。
|
2025-06-01 18:52:23 +08:00 |
|
|
小铭
|
94aa25bdea
|
Merge pull request #140 from xming521/xming521-patch-5
Update settings.template.jsonc
|
2025-06-01 10:12:10 +08:00 |
|
|
小铭
|
cc27876139
|
Update settings.template.jsonc
|
2025-06-01 10:11:58 +08:00 |
|
|
xming521
|
a12a0671f0
|
更新pyproject.toml中的transformers版本，添加accelerate依赖；在mllm模板中增加media_dir和image_max_pixels配置；优化qa_generatorV2.py中的数据处理逻辑以支持image_max_pixels参数；更新length_cdf函数以支持image_max_pixels参数。
|
2025-05-31 22:19:01 +08:00 |
|
|
xming521
|
11b0e3fbd3
|
Update .gitignore to ignore the dataset/images directory, modify the transformers version in pyproject.toml, adjust the clean_dataset configuration in settings.template.jsonc, add media_dir to the mllm template, optimize data processing logic in qa_generatorV2.py and utils.py, update the length_cdf function to support the media_dir parameter.
|
2025-05-31 10:24:51 +08:00 |
|
|
xming521
|
7ee6289ae4
|
修正check_image_file_exists函数中的文件匹配逻辑。
|
2025-05-30 15:49:20 +08:00 |
|
|
xming521
|
db873b37b0
|
Merge remote-tracking branch 'origin/master' into dev
|
2025-05-30 15:27:25 +08:00 |
|
|
xming521
|
0f9d737433
|
length_cdf间隔将其固定为512。
|
2025-05-30 15:20:08 +08:00 |
|
|
xming521
|
7bc76d57c9
|
更新mllm模板。
|
2025-05-30 11:39:26 +08:00 |
|
|
小铭
|
5a44fa4954
|
Merge pull request #137 from xming521/xming521-patch-4
Update issue-labeler.yml
|
2025-05-30 10:43:50 +08:00 |
|
|
小铭
|
f12f8945bc
|
Update issue-labeler.yml
|
2025-05-30 10:43:39 +08:00 |
|
|
小铭
|
375d24c4e7
|
Merge pull request #134 from xming521/xming521-patch-3
Update issue-labeler.yml
|
2025-05-30 10:08:56 +08:00 |
|
|
小铭
|
052c5faf4d
|
Update issue-labeler.yml
|
2025-05-30 10:08:43 +08:00 |
|
|
xming521
|
4d69b0c9b6
|
更新mllm模板以支持最大图片数量，优化数据处理逻辑。
|
2025-05-29 23:20:11 +08:00 |
|
|
小铭
|
34fa44f357
|
Merge pull request #132 from xming521/xming521-patch-2
Update README.md
|
2025-05-29 15:53:33 +08:00 |
|
|
小铭
|
f5d0976423
|
Update README.md
|
2025-05-29 15:53:19 +08:00 |
|
|
xming521
|
b09edad868
|
improve qag V2
|
2025-05-28 23:21:53 +08:00 |
|
|
小铭
|
d9067920b6
|
Merge pull request #131 from xming521/xming521-patch-5
Update README.md
|
2025-05-28 20:40:16 +08:00 |
|
|
小铭
|
b57888bbbe
|
Update README.md
|
2025-05-28 20:11:43 +08:00 |
|
|
xming521
|
babba7233a
|
Merge remote-tracking branch 'origin/master' into dev
|
2025-05-28 19:55:36 +08:00 |
|
|
小铭
|
5c404c1709
|
Merge pull request #130 from BAIKEMARK/update-clean-strategy
fix online_llm_clear
|
2025-05-28 19:54:12 +08:00 |
|
|
Mark
|
1898e48107
|
Merge branch 'master' into update-clean-strategy
|
2025-05-28 18:56:44 +08:00 |
|
|
BAIKEMARK
|
c19805d44a
|
Merge branch 'update-clean-strategy' of https://github.com/BAIKEMARK/WeClone into update-clean-strategy
|
2025-05-28 18:54:19 +08:00 |
|
|
BAIKEMARK
|
f2e79ad411
|
Fixed the bug where vllm uninstallation caused the inability to use online cleaning.
|
2025-05-28 18:54:15 +08:00 |
|
|
xming521
|
7e4b0433f1
|
add QaPairV2
|
2025-05-27 23:07:17 +08:00 |
|
|
xming521
|
5c28bf084e
|
更新数据模型以支持ShareGPT格式，新增QaPairV2类和Message类，修改数据处理逻辑以支持图片消息，优化图片文件检查功能。
|
2025-05-25 23:23:58 +08:00 |
|
|
xming521
|
54cc16d29d
|
Merge remote-tracking branch 'origin/master' into dev
|
2025-05-24 23:27:29 +08:00 |
|
|
xming521
|
07662a3dc1
|
更新pyproject.toml以使用llamafactory的GitHub链接，修改settings.template.jsonc以更新模型路径和添加平台配置，增强数据处理逻辑以支持多语言切割类型，并在qa_generator.py中整合切割类型列表。
|
2025-05-24 23:24:26 +08:00 |
|
|
小铭
|
39ae0c791a
|
Merge pull request #126 from BAIKEMARK/update-clean-strategy
fix onlin clean strategy and update README.md
|
2025-05-24 22:53:14 +08:00 |
|
|
小铭
|
a0b6863b15
|
Update README.md
|
2025-05-24 22:30:25 +08:00 |
|
|
BAIKEMARK
|
ddd6b49af3
|
Changed commentjson back to json
|
2025-05-24 22:15:27 +08:00 |
|
|
BAIKEMARK
|
b5c34ea521
|
update readme
|
2025-05-24 22:11:37 +08:00 |
|