Commit Graph
26 Commits
Author SHA1 Message Date
cwz_eikoh 7598268cd5 fix(vllm): user customize args & health check in hostlocal net (#24543) 2026-03-25 10:36:21 +08:00
Zexi Li e25d6eb814 feat(llm): unify container access url info and login response (#24505) 2026-03-19 23:06:44 +08:00
cwz_eikoh bdc211a779 feat(llm): support model import for vllm (#24499) 2026-03-19 15:03:35 +08:00
Zexi Li 98b7509522 fix(llm): derive openclaw auth password from llm id (#24482) 2026-03-18 19:02:14 +08:00
Zexi Li 3dcc91434c feat(llm): add llm_types filters and cleanup dify cli (#24458) 2026-03-16 18:05:05 +08:00
Zexi Li 04d29503ee feat(llm): 调整 openclaw 容器与 LLM 基础模型/sku 逻辑 (#24455) 2026-03-16 16:20:01 +08:00
Zexi Li 169ff8fcab fix(llm): mount openclaw home dir (#24451) 2026-03-13 20:38:48 +08:00
cwz_eikoh d3ab4af466 feat(llm): init vllm as llm_container (#24338)
* feat(llm): init vllm as llm_container

* feat(vllm): fix save-instant-model for vllm

* feat(llm): support quick-model for vllm

* feat(vllm): support preferred-model in llm

* fix(llm): add ValidateSpec in llm_container_driver

* feat(vllm): auto-set vllm params
2026-03-13 11:07:02 +08:00
Zexi Li cf2f140c08 feat(llm): add login-info api (#24431) 2026-03-12 07:21:20 +08:00
Zexi Li 6dbc39b04f feat(llm): restart action (#24427) 2026-03-11 19:08:28 +08:00
Zexi Li 3bdd431db0 Automated cherry pick of #24411: openclaw llm agent (#24420)
* support comfyui and openclaw

feat(region,host): support env credential of container

feat(llm): openclaw url

* fix(region): delete server without host_id

* feat(llm): llm spec
2026-03-11 15:21:31 +08:00
cwz_eikoh 4d625207bb feat(llm): polymetric dify with llm (#24399)
* feat(llm): polymetric dify with llm

* fix(llm): drop LLMSpecHolder & fix some bugs
2026-03-10 10:23:34 +08:00
cwz_eikoh a279c4f89f fix: some bugs in mcp-agent & llm (#24355)
* fix(mcp-agent): encoding issue when simulated streaming

* fix(mcp-agent): use chat-stream in phase tool-choose

* fix(mcp-agent): support reasoning model

* fix(llm): add pre-delete detection

* feat(mcp-agent): add default mcp-agent

* feat(mcp-agent): add default-mcp-tools
2026-03-03 16:07:32 +08:00
cwz_eikoh 8b10d33682 Fix(llm): some mistakes, use CmpId & InstantModelId insteadof SvrId & ModelId (#24194)
* fix(llm): some mistakes

* fix(llm): use CmpId instead of SvrId

* fix(llm): instant_model use id instead of modelId
2026-02-03 15:15:15 +08:00
cwz_eikoh e254c2ccf5 Fix(llm): fix bugs & apikey encrypt & support history for mcp-agent-chat & delete modelname in llmSku (#24149)
* fix(llm): mcp-agent apiKey encrypt

* fix(llm): error-handle when instant-model import

* feature(llm): add get-available-network for llm

* feature(llm): support history for mcp-agent-chat

* fix(llm): llm create with net instead of networktype & networkid

* fix(llm): delete modelName in llmSku & fix some bugs
2026-01-29 10:50:00 +08:00
屈轩 5f9974b249 fix(glance): support prob iso image (#24128) 2026-01-28 15:28:47 +08:00
Zexi Li 86a47f9e86 fix(llm): add community-registry api (#24131) 2026-01-28 14:30:53 +08:00
cwz_eikoh 1fc8219ee4 feature(llm): adapt frontend (#23906)
* feature(llm): add llm-list details, add autostart for llm-save-instant-model

* fix(llm): adjust some interfaces

* fix: name-dup problem when create llm

* fix: install instant-model by id rather than modelID

* fix(llm): add llm_id for mcp-agent

* feature(llm): move network from sku to instance

* feature(llm): add LLMType for llm-image

* feature(llm): add gpuMemoryRequired & ollama-registry yaml

* feature(llm): add url-get interface

* feature(llm): support mcp in mcp-agent-chat

* fix(llm): abstract ollama registry
2026-01-19 18:06:05 +08:00
cwz_eikoh e9382c9ae7 feature(llm): add mcp-agent (#24025)
* feature(llm): add mcp-agent

* feature(llm): support openai in llm_client

* feature(llm): chat-stream demo
2026-01-12 10:45:53 +08:00
Jian QiuandQiu Jian f50f83feb1 fix: endpoint mode slave (#24016)
Co-authored-by: Qiu Jian <qiujian@yunionyun.com>
2026-01-06 18:05:41 +08:00
cwz_eikoh 805b8afe9d feature(llm): add llm-instant-model-import (#23928)
* feature(llm): add llm-instant-model-import

* fix(llm): can't delete llm while deploy faile

* feature(llm): add instant-model-import to instant-model-create
2025-12-17 13:33:57 +08:00
cwz_eikoh 4c701fa082 Feature/pre quick model (#23898)
* feat: add preinstall for quick-models

* fix: drop error when duplicate blobs
2025-12-05 10:33:45 +08:00
cwz_eikohandZexi Li 142e540f7f [Feature] llm model 使用 post_overlay 功能实现秒装挂载模型 (#23769)
* feat(llm): add probed-package

* feat(llm): add llm-save-instant-app

* feat(llm): add some llm-instant-app options

* fix(llm): change app to model

* fix(llm): rename origin model to sku

* feat(llm): add llm-quick-models

* fix(llm): saved paths for instant model

* fix(llm): fix quick-install-model

---------

Co-authored-by: Zexi Li <zexi.li@icloud.com>
2025-12-03 16:27:10 +08:00
cwz_eikoh c414ef4eda fix(llm): don't rely on polling (#23708) 2025-11-07 10:19:30 +08:00
cwz_eikoh f1f502cac4 feat(llm): add network id and network type for llm-model (#23620)
* feat(llm): add network id and network type for llm-model

* fix(llm):portmapping of model network only works when network mode is hostlocal
2025-10-31 10:21:41 +08:00
cwz_eikoh 897a6fc61f [OSPP]feature: Auto deploy llm and dify (#23282)
* feat(llm): add llm-create

* fix(llm): fix llm-create, add llm-list & llm-show

* fix(llm): format file names

* fear(llm): add exec stream

* fear(llm): init llm model cache

* fix(llm): move llm model cache to LocalImageCache

* feat(llm): auto clean model cache

* fix(llm): auto clean tmp model cache

* feat(dify): init dify-create

* fix(dify): change dify default registry

* feat: support create model with gguf file

* feat(llm): support more modelfile option for gguf file

* feat(dify): init user customize dify parameters

* feat: update llm as a service in climc

* fix: delete llm from region service

* feat: init llm service (with error)

* fix: resolve errors (task cant callback yet)

* feat: add PerformRequestHostActionByOtherService for container

* fix: make llm service usable

* feat: delete llm and dify after guest deleted

* feat(llm): add llm-image

* feat(llm): add llm-model

* feat: mv old llm to ollama

* feat(llm): init llm-batch-create(can not run)

* fix(llm): make llm-create usable

* fix(llm): add pull-model step

* feat(llm): add list and delete

* fix(llm): ollama pull official model don't rely on host & region's code any more

* feat(llm): add dify-model

* fix: remove llm's code in host & compute

* fix: remove remain code in compute

* feat(llm): Abstract out and reuse the llm_model logic

* feat(llm): abstract llm_base from llm

* fix(llm): make dify usable

* feat(llm): add sync_dify_images.sh

* fix(llm): format import

* feat(llm): support start & stop for llm and dify

* feat(llm): add model-update

* fix(llm): gendocgo
2025-10-24 13:29:31 +08:00