 BAIKEMARK
|
f3f0b61ad9
|
更新setting模板
|
2025-06-12 20:34:01 +08:00 |
|
|
xming521
|
6e1903ced6
|
修改数据集名称为chat-sft， 纯文字模型微调数据切换到sharegpt格式。
|
2025-06-11 15:34:27 +08:00 |
|
|
xming521
|
a703188a4e
|
Merge remote-tracking branch 'origin/master' into dev
|
2025-06-01 18:52:46 +08:00 |
|
|
小铭
|
cc27876139
|
Update settings.template.jsonc
|
2025-06-01 10:11:58 +08:00 |
|
|
xming521
|
11b0e3fbd3
|
Update .gitignore to ignore the dataset/images directory, modify the transformers version in pyproject.toml, adjust the clean_dataset configuration in settings.template.jsonc, add media_dir to the mllm template, optimize data processing logic in qa_generatorV2.py and utils.py, update the length_cdf function to support the media_dir parameter.
|
2025-05-31 10:24:51 +08:00 |
|
|
xming521
|
7e4b0433f1
|
add QaPairV2
|
2025-05-27 23:07:17 +08:00 |
|
|
xming521
|
07662a3dc1
|
更新pyproject.toml以使用llamafactory的GitHub链接，修改settings.template.jsonc以更新模型路径和添加平台配置，增强数据处理逻辑以支持多语言切割类型，并在qa_generator.py中整合切割类型列表。
|
2025-05-24 23:24:26 +08:00 |
|
|
xming521
|
9f59ec4261
|
更新版本号至0.2.22，添加微信图片复制功能，更新.gitignore以包含新目录
|
2025-05-24 15:32:37 +08:00 |
|
|
xming521
|
906b724524
|
change settings.template.jsonc
|
2025-05-23 15:50:43 +08:00 |
|
|
niulinbiao
|
84f2577837
|
Merge branch 'master' into nb-dev
|
2025-05-22 20:13:05 +08:00 |
|
|
niuben
|
bcf89d22e9
|
实现在线LLM清洗数据
|
2025-05-22 19:50:57 +08:00 |
|
|
xming521
|
ed9d8e320e
|
Adjust the default values of lora_dropout and num_train_epochs, while applying a unified decorator in the CLI to support log capturing. Use an inelegant approach to print all terminal content to a file, enabled via full_log.
|
2025-05-21 21:57:12 +08:00 |
|
|
xming521
|
a18e474720
|
禁用词配置改到settings.json。
|
2025-05-08 20:44:32 +08:00 |
|
|
xming521
|
d7b77483a5
|
update llm judge
|
2025-05-05 19:52:29 +08:00 |
|
|
xming521
|
810ca43f45
|
将配置文件名从settings.json更改为settings.jsonc
|
2025-05-03 14:50:22 +08:00 |
|