Zexi Li
2de295222d
feat(llm): merge SKU envs into container and validate prefer_hosts updates ( #25389 )
...
Allow local_path SKUs to update prefer_hosts on edit, and overlay SKU envs onto the primary container with same-key override.
2026-08-21 14:27:58 +08:00
Zexi Li
a13a322bf2
feat(llm): sync isolated devices by sharing_mode on restart ( #25307 )
...
Respect sharing_mode when attaching/restoring GPU devices in compute,
and sync LLM guest devices with SKU config instead of only detaching
when empty.
2026-08-12 20:17:22 +08:00
Zexi Li
e7edd821c1
fix(llm): detach stale GPUs when effective devices are empty on restart ( #25280 )
...
Avoid keeping bound isolated devices after SKU/LLM devices are cleared;
desktop container setup now follows effective devices only.
2026-08-06 10:02:22 +08:00
Zexi Li
eab7db5518
feat(llm,host): support Hygon DCU runtime for vLLM containers ( #25260 )
...
Wire vendor on LLM SKU devices, resolve supplemental groups for DCU
access, source DTK env in vLLM entrypoint, and add hysmi telegraf metrics.
2026-08-02 13:52:16 +08:00
Zexi Li
3431c10196
feat(llm): support local_path scheduling with prefer_hosts and deployment restart ( #25090 )
2026-07-01 13:11:19 +08:00
Zexi Li
6c4d68f3b8
fix(llm): honor SLLM device override when building container spec ( #24799 )
2026-05-11 20:06:35 +08:00
Zexi Li
b2ec881a68
feat(llm): add SLLM mounted_models override and driver-level validation ( #24797 )
2026-05-11 17:41:28 +08:00
cwz_eikoh
ff89a3839b
feat(llm): add hostpaths for llm-sku ( #24693 )
2026-04-20 10:51:16 +08:00
Zexi Li
04d29503ee
feat(llm): 调整 openclaw 容器与 LLM 基础模型/sku 逻辑 ( #24455 )
2026-03-16 16:20:01 +08:00
cwz_eikoh
8b10d33682
Fix(llm): some mistakes, use CmpId & InstantModelId insteadof SvrId & ModelId ( #24194 )
...
* fix(llm): some mistakes
* fix(llm): use CmpId instead of SvrId
* fix(llm): instant_model use id instead of modelId
2026-02-03 15:15:15 +08:00
cwz_eikoh
e254c2ccf5
Fix(llm): fix bugs & apikey encrypt & support history for mcp-agent-chat & delete modelname in llmSku ( #24149 )
...
* fix(llm): mcp-agent apiKey encrypt
* fix(llm): error-handle when instant-model import
* feature(llm): add get-available-network for llm
* feature(llm): support history for mcp-agent-chat
* fix(llm): llm create with net instead of networktype & networkid
* fix(llm): delete modelName in llmSku & fix some bugs
2026-01-29 10:50:00 +08:00
cwz_eikoh
1fc8219ee4
feature(llm): adapt frontend ( #23906 )
...
* feature(llm): add llm-list details, add autostart for llm-save-instant-model
* fix(llm): adjust some interfaces
* fix: name-dup problem when create llm
* fix: install instant-model by id rather than modelID
* fix(llm): add llm_id for mcp-agent
* feature(llm): move network from sku to instance
* feature(llm): add LLMType for llm-image
* feature(llm): add gpuMemoryRequired & ollama-registry yaml
* feature(llm): add url-get interface
* feature(llm): support mcp in mcp-agent-chat
* fix(llm): abstract ollama registry
2026-01-19 18:06:05 +08:00
cwz_eikoh
4c701fa082
Feature/pre quick model ( #23898 )
...
* feat: add preinstall for quick-models
* fix: drop error when duplicate blobs
2025-12-05 10:33:45 +08:00
cwz_eikoh
142e540f7f
[Feature] llm model 使用 post_overlay 功能实现秒装挂载模型 ( #23769 )
...
* feat(llm): add probed-package
* feat(llm): add llm-save-instant-app
* feat(llm): add some llm-instant-app options
* fix(llm): change app to model
* fix(llm): rename origin model to sku
* feat(llm): add llm-quick-models
* fix(llm): saved paths for instant model
* fix(llm): fix quick-install-model
---------
Co-authored-by: Zexi Li <zexi.li@icloud.com >
2025-12-03 16:27:10 +08:00
cwz_eikoh
c414ef4eda
fix(llm): don't rely on polling ( #23708 )
2025-11-07 10:19:30 +08:00
cwz_eikoh
897a6fc61f
[OSPP]feature: Auto deploy llm and dify ( #23282 )
...
* feat(llm): add llm-create
* fix(llm): fix llm-create, add llm-list & llm-show
* fix(llm): format file names
* fear(llm): add exec stream
* fear(llm): init llm model cache
* fix(llm): move llm model cache to LocalImageCache
* feat(llm): auto clean model cache
* fix(llm): auto clean tmp model cache
* feat(dify): init dify-create
* fix(dify): change dify default registry
* feat: support create model with gguf file
* feat(llm): support more modelfile option for gguf file
* feat(dify): init user customize dify parameters
* feat: update llm as a service in climc
* fix: delete llm from region service
* feat: init llm service (with error)
* fix: resolve errors (task cant callback yet)
* feat: add PerformRequestHostActionByOtherService for container
* fix: make llm service usable
* feat: delete llm and dify after guest deleted
* feat(llm): add llm-image
* feat(llm): add llm-model
* feat: mv old llm to ollama
* feat(llm): init llm-batch-create(can not run)
* fix(llm): make llm-create usable
* fix(llm): add pull-model step
* feat(llm): add list and delete
* fix(llm): ollama pull official model don't rely on host & region's code any more
* feat(llm): add dify-model
* fix: remove llm's code in host & compute
* fix: remove remain code in compute
* feat(llm): Abstract out and reuse the llm_model logic
* feat(llm): abstract llm_base from llm
* fix(llm): make dify usable
* feat(llm): add sync_dify_images.sh
* fix(llm): format import
* feat(llm): support start & stop for llm and dify
* feat(llm): add model-update
* fix(llm): gendocgo
2025-10-24 13:29:31 +08:00