mirror of
https://github.com/xming521/WeClone.git
synced 2026-08-30 18:02:19 +08:00
5dcaad0e10
Adds a call to empty the CUDA cache immediately after the LLM object is deleted, ensuring prompt release of GPU memory. This helps prevent out-of-memory issues and improves resource utilization for subsequent operations.