Files
WeClone-new/examples
xming521 5a560adafb perf(train): optimize default training configs
Increases LoRA rank from 4 to 16 in example and default configurations.
This aims to improve model fine-tuning effectiveness.

Adjusts per-device batch size and gradient accumulation steps. This
maintains the same effective batch size while potentially reducing
memory usage.

Standardizes LoRA dropout to 0.25 across configurations.

Updates READMEs to clarify model performance expectations.
2025-07-17 22:21:54 +08:00
..