mirror of
https://github.com/xming521/WeClone.git
synced 2026-08-28 18:07:28 +08:00
5a560adafb
Increases LoRA rank from 4 to 16 in example and default configurations. This aims to improve model fine-tuning effectiveness. Adjusts per-device batch size and gradient accumulation steps. This maintains the same effective batch size while potentially reducing memory usage. Standardizes LoRA dropout to 0.25 across configurations. Updates READMEs to clarify model performance expectations.