opensource/cloudpods
3
0
Fork 0
mirror of https://github.com/yunionio/cloudpods.git synced 2026-09-21 14:19:49 +08:00
Code Issues Packages Projects Releases Wiki Activity
20,806 Commits 27 Branches 687 Tags
f4503e22845748f74e6f0dcb4e3bfe4643fee887
Commit Graph
38 Commits
Author SHA1 Message Date
Zexi Li f4503e2284 feat(llm): add SLLM mounted_models override and driver-level validation (#24795) 2026-05-11 17:41:05 +08:00
Zexi Liandcwz dc4fd66eba Automated cherry pick of #24760: Feature/comfyui instant model (#24775) 
* feat(llm): support cursor

* feat(llm): support import from huggingface

* fix(llm): direction error

* feat(llm): support instant model for comfyui

* feat(llm): support multi file select when save-instant-model

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-05-07 14:42:53 +08:00
wanyaoqi e9dde8eae6 fix(mcclient,region): add tasks mod, service app options (#24734) 2026-04-29 23:48:06 +08:00
Zexi Li 0f30ccf520 fix(host,llm): fix pod shm mount path return and llm restart memory config (#24737) 
- Return shmPath instead of empty string when mountpoint is already
  mounted, so callers get the correct path
- Remove incorrect +1 offset in memory comparison and size formatting
  during LLM restart config change
 2026-04-28 19:57:42 +08:00
Zexi Li 9be35e4b45 feat(llm): support OpenClaw manual config mode (#24719) 
When ManualConfig is enabled, inject OPENCLAW_MANUAL_CONFIG=1 env var
and skip provider/channel credential injection, allowing users to
configure providers and channels themselves inside the desktop.
 2026-04-24 11:45:46 +08:00
Zexi Liandcwz 67cceae9e2 Automated cherry pick of #24717: Feature/hf-search (#24718) 
* llm: add instant-model huggingface query commands

* fix(vllm): use ping instead of health

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-04-24 10:28:34 +08:00
Zexi Li 6372ef9819 refactor(llm): extract shared desktop webtop config (#24699) 
Move common desktop/webtop container envs, base spec, rootfs, and login-info parsing
into llm_container helpers and reuse in openclaw and hermes-agent drivers.
 2026-04-21 15:04:44 +08:00
Zexi Li 23e21c2c16 feat(llm): support hermes-agent (#24696) 2026-04-20 12:47:23 +08:00
Zexi Liandcwz 2ee8ae31ad feat(llm): add hostpaths for llm-sku (#24695) 
Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-04-20 10:51:40 +08:00
Zexi Li 218c973638 fix(llm): harden volume resize and update size log (#24631) 
- Wait for disk/desktop status after resize via backup worker
- Centralize volume SizeMB update with resize action log
- Expose vCPU/memory fields in LLM customize columns
 2026-04-13 14:38:50 +08:00
Zexi Liandcwz dffac28e32 feat(llm): get available models from base_url (for ollama & openai) (#24608) 
Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-04-01 15:44:30 +08:00
Zexi Li e205da2232 fix(llm): 修复 llm 镜像没有根据 sku 更新的问题 (#24572) 2026-03-26 21:38:21 +08:00
Zexi Liandcwz b1f7890324 fix(vllm): user customize args & health check in hostlocal net (#24553) 
Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-03-25 10:36:46 +08:00
Zexi Li ef6241ac9b feat(llm): unify container access url info and login response (#24504) 2026-03-19 23:06:31 +08:00
cwz_eikoh e3e04ab29d feat(llm): support model import for vllm (#24503) 2026-03-19 15:03:49 +08:00
Zexi Li 3e925b6d95 fix(llm): derive openclaw auth password from llm id (#24480) 2026-03-18 19:01:02 +08:00
Zexi Li 354e3cd872 feat(llm): add llm_types filters and cleanup dify cli (#24457) 2026-03-16 17:01:36 +08:00
Zexi Li 8c6167bb7b feat(llm): 调整 openclaw 容器与 LLM 基础模型/sku 逻辑 (#24453) 2026-03-16 16:19:40 +08:00
Zexi Li ace220a0ca fix(llm): mount openclaw home dir (#24449) 2026-03-13 20:38:28 +08:00
cwz_eikoh 2c59756f75 Automated cherry pick of #24338: feat(llm): init vllm as llm_container (#24437) 
* feat(llm): init vllm as llm_container

* feat(vllm): fix save-instant-model for vllm

* feat(llm): support quick-model for vllm

* feat(vllm): support preferred-model in llm

* fix(llm): add ValidateSpec in llm_container_driver

* feat(vllm): auto-set vllm params
 2026-03-13 11:07:19 +08:00
Zexi Li 25d1965950 feat(llm): add login-info api (#24429) 2026-03-12 07:20:43 +08:00
Zexi Li 88f9b71e53 feat(llm): restart action (#24426) 2026-03-11 19:07:39 +08:00
Zexi Li 81d1308ddd openclaw llm agent (#24411) 
* support comfyui and openclaw

feat(region,host): support env credential of container

feat(llm): openclaw url

* fix(region): delete server without host_id

* feat(llm): llm spec
 2026-03-11 15:21:10 +08:00
Zexi Liandcwz 804cbbfd45 Automated cherry pick of #24399: feat(llm): polymetric dify with llm (#24405) 
* feat(llm): polymetric dify with llm

* fix(llm): drop LLMSpecHolder & fix some bugs

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-03-10 10:23:44 +08:00
cwz_eikoh 64d3842c93 Automated cherry pick of #24355: fix: some bugs in mcp-agent & llm (#24383) 
* fix(mcp-agent): encoding issue when simulated streaming

* fix(mcp-agent): use chat-stream in phase tool-choose

* fix(mcp-agent): support reasoning model

* fix(llm): add pre-delete detection

* feat(mcp-agent): add default mcp-agent

* feat(mcp-agent): add default-mcp-tools
 2026-03-03 16:08:22 +08:00
Zexi Liandcwz 3e982a7438 Automated cherry pick of #24194: Fix(llm): some mistakes, use CmpId & InstantModelId insteadof SvrId & ModelId (#24205) 
* fix(llm): some mistakes

* fix(llm): use CmpId instead of SvrId

* fix(llm): instant_model use id instead of modelId

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-02-03 16:46:07 +08:00
cwz_eikoh f2cc3f0c18 Automated cherry pick of #24149: Fix(llm): fix bugs & apikey encrypt & support history for mcp-agent-chat & delete modelname in llmSku (#24150) 
* fix(llm): mcp-agent apiKey encrypt

* fix(llm): error-handle when instant-model import

* feature(llm): add get-available-network for llm

* feature(llm): support history for mcp-agent-chat

* fix(llm): llm create with net instead of networktype & networkid

* fix(llm): delete modelName in llmSku & fix some bugs
 2026-01-29 10:50:11 +08:00
屈轩 fa08f8fd8f fix(glance): support prob iso image (#24133) 2026-01-28 15:28:56 +08:00
Zexi Li 7f54e038c0 fix(llm): add community-registry api (#24130) 2026-01-28 14:30:43 +08:00
cwz_eikoh 8c20fb7e3d Automated cherry pick of #23906: feature(llm): adapt frontend (#24095) 
* feature(llm): add llm-list details, add autostart for llm-save-instant-model

* fix(llm): adjust some interfaces

* fix: name-dup problem when create llm

* fix: install instant-model by id rather than modelID

* fix(llm): add llm_id for mcp-agent

* feature(llm): move network from sku to instance

* feature(llm): add LLMType for llm-image

* feature(llm): add gpuMemoryRequired & ollama-registry yaml

* feature(llm): add url-get interface

* feature(llm): support mcp in mcp-agent-chat

* fix(llm): abstract ollama registry
 2026-01-19 18:06:18 +08:00
cwz_eikoh 0ff02020e7 Automated cherry pick of #24025: feature(llm): add mcp-agent (#24026) 
* feature(llm): add mcp-agent

* feature(llm): support openai in llm_client

* feature(llm): chat-stream demo
 2026-01-12 10:46:06 +08:00
Jian QiuandQiu Jian 8fb0236de5 fix: endpoint mode slave (#24023) 
Co-authored-by: Qiu Jian <qiujian@yunionyun.com>
 2026-01-06 18:05:27 +08:00
cwz_eikoh 09b5ecbce0 Automated cherry pick of #23928: feature(llm): add llm-instant-model-import (#23929) 
* feature(llm): add llm-instant-model-import

* fix(llm): can't delete llm while deploy faile

* feature(llm): add instant-model-import to instant-model-create
 2025-12-17 13:34:07 +08:00
cwz_eikoh 9ac509e55b Automated cherry pick of #23898: Feature/pre quick model (#23899) 
* feat: add preinstall for quick-models

* fix: drop error when duplicate blobs
 2025-12-05 10:33:55 +08:00
cwz_eikohandZexi Li 80287d6b4d Automated cherry pick of #23769: [Feature] llm model 使用 post_overlay 功能实现秒装挂载模型 (#23888) 
* feat(llm): add probed-package

* feat(llm): add llm-save-instant-app

* feat(llm): add some llm-instant-app options

* fix(llm): change app to model

* fix(llm): rename origin model to sku

* feat(llm): add llm-quick-models

* fix(llm): saved paths for instant model

* fix(llm): fix quick-install-model

---------

Co-authored-by: Zexi Li <zexi.li@icloud.com>
 2025-12-03 16:27:19 +08:00
cwz_eikoh bf4f1755c8 fix(llm): don't rely on polling (#23709) 2025-11-07 10:19:37 +08:00
cwz_eikoh 66afa2f141 Automated cherry pick of #23620: feat(llm): add network id and network type for llm-model (#23621) 
* feat(llm): add network id and network type for llm-model

* fix(llm):portmapping of model network only works when network mode is hostlocal
 2025-10-31 10:21:51 +08:00
Zexi Liandcwz 2bbd1f792c Automated cherry pick of #23282: [OSPP]feature: Auto deploy llm and dify (#23601) 
* feat(llm): add llm-create

* fix(llm): fix llm-create, add llm-list & llm-show

* fix(llm): format file names

* fear(llm): add exec stream

* fear(llm): init llm model cache

* fix(llm): move llm model cache to LocalImageCache

* feat(llm): auto clean model cache

* fix(llm): auto clean tmp model cache

* feat(dify): init dify-create

* fix(dify): change dify default registry

* feat: support create model with gguf file

* feat(llm): support more modelfile option for gguf file

* feat(dify): init user customize dify parameters

* feat: update llm as a service in climc

* fix: delete llm from region service

* feat: init llm service (with error)

* fix: resolve errors (task cant callback yet)

* feat: add PerformRequestHostActionByOtherService for container

* fix: make llm service usable

* feat: delete llm and dify after guest deleted

* feat(llm): add llm-image

* feat(llm): add llm-model

* feat: mv old llm to ollama

* feat(llm): init llm-batch-create(can not run)

* fix(llm): make llm-create usable

* fix(llm): add pull-model step

* feat(llm): add list and delete

* fix(llm): ollama pull official model don't rely on host & region's code any more

* feat(llm): add dify-model

* fix: remove llm's code in host & compute

* fix: remove remain code in compute

* feat(llm): Abstract out and reuse the llm_model logic

* feat(llm): abstract llm_base from llm

* fix(llm): make dify usable

* feat(llm): add sync_dify_images.sh

* fix(llm): format import

* feat(llm): support start & stop for llm and dify

* feat(llm): add model-update

* fix(llm): gendocgo

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2025-10-24 13:29:40 +08:00