opensource/cloudpods
3
0
Fork 0
mirror of https://github.com/yunionio/cloudpods.git synced 2026-09-19 02:37:24 +08:00
Code Issues Packages Projects Releases Wiki Activity
21,023 Commits 27 Branches 687 Tags
1312d0d4cfd98734c2dabed12c0ed3f8f07c4eba
Commit Graph
89 Commits
Author SHA1 Message Date
Jian QiuQiu JianClaude
 		1312d0d4cf fix: mask tokens and passwords in logs (#25513) 
Full session tokens were written to logs in policy.go, mcclient auth,
oidc handler and the webconsole session manager; guest root passwords
were logged by the linux fsdriver and the nbdkit mount command; MCP
tool arguments and full JSON-RPC bodies (which may contain
server-reset-password passwords) were logged by the llm agent.

Truncate tokens in log messages, drop or mask password values and
log only the tool/method name for MCP calls.

Co-authored-by: Qiu Jian <qiujian@yunionyun.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-09-03 19:20:36 +08:00
Zexi Li 73d9b55d41 feat(llm): add llm_sku clone API and climc support (#25443) 2026-08-27 19:01:03 +08:00
Zexi Li 177c09758a feat(llm): merge SKU envs into container and validate prefer_hosts updates (#25387) 
Allow local_path SKUs to update prefer_hosts on edit, and overlay SKU envs onto the primary container with same-key override.
 2026-08-21 14:27:32 +08:00
Jian QiuandQiu Jian 72f0867b9c fix: unhandled errors (#25375) 
Co-authored-by: Qiu Jian <qiujian@yunionyun.com>
 2026-08-20 17:30:16 +08:00
wanyaoqi 99d579ab58 fix(region,host): guest stop add timeout options，and check is_force (#25365) 
* fix(host): check qga guest-get-osinfo error

* fix(region,host): guest stop add timeout options and is_force check
 2026-08-20 10:15:18 +08:00
Zexi Li 7fde987f93 feat(llm): check sku schedule info (#24910) 2026-08-19 12:17:53 +08:00
Zexi Li 15122230cc feat(aiproxy): migrate catalog resources to virtual resource base (#25309) 
Give ai providers/models/keys/routing-models project scope with tenant backfill, and pass project/domain on LLM sync upserts.
 2026-08-14 10:44:42 +08:00
Zexi Li 212351edf6 feat(llm): sync isolated devices by sharing_mode on restart (#25305) 
Respect sharing_mode when attaching/restoring GPU devices in compute,
and sync LLM guest devices with SKU config instead of only detaching
when empty.
 2026-08-12 20:16:55 +08:00
Zexi Li 6e6e9a87d2 fix(llm): detach stale GPUs when effective devices are empty on restart (#25278) 
Avoid keeping bound isolated devices after SKU/LLM devices are cleared;
desktop container setup now follows effective devices only.
 2026-08-06 10:01:46 +08:00
Zexi Li bd9f7f7e14 fix(aiproxy): keep weight=1 keys selectable after health penalty (#25276) 
Integer truncation of base*mul/maxScore can yield 0 for weight=1 keys,
permanently excluding them; floor effective weight at 1 when mul > 0.
 2026-08-04 20:25:08 +08:00
Zexi Li 035631f0ae feat(host): support Hygon DCU HAMI vdev core allocation (#25272) 2026-08-04 10:20:28 +08:00
Zexi Li 19e752f3a4 fix(llm): derive aiproxy upstream model key from local_path sku (#25269) 2026-08-03 15:43:54 +08:00
Zexi Li d45131bbe0 feat(llm,host): support Hygon DCU runtime for vLLM containers (#25258) 
Wire vendor on LLM SKU devices, resolve supplemental groups for DCU
access, source DTK env in vLLM entrypoint, and add hysmi telegraf metrics.
 2026-08-02 13:51:44 +08:00
Zexi Li b936bb2f40 feat(host): support Hygon DCU isolated device and HAMI (#25245) 
Add Hygon DCU container device passthrough, HAMI vGPU sharing, vendor
field/filter on isolated devices, remote path helper, and LLM SKU mapping.
 2026-07-29 19:01:33 +08:00
Zexi Li 0fa97910f3 fix(llm): require memory_mb for local_path HAMi devices (#25220) 
local_path SKUs cannot estimate VRAM from InstantModel; validate HAMi devices set devices[].memory_mb on create/update and deployment.
 2026-07-29 10:21:57 +08:00
Zexi Li a1012f738a feat(llm): support hami (#25215) 2026-07-23 17:08:37 +08:00
屈轩 5f0cb67c4d fix(mcp-server): optimized mcp desc (#25194) 2026-07-21 16:19:25 +08:00
屈轩 21822dc778 fix(mcp-server): mcp use climc struct (#25184) 2026-07-20 17:17:24 +08:00
wanyaoqi 574cac011a feat(region,host,scheduler): isolated device refactor and hami support (#25129) 2026-07-20 13:04:51 +08:00
Zexi Li 98d4515548 feat(aiproxy): auto-provision placeholder ai_key for upstream resolve (#25155) 2026-07-15 19:24:43 +08:00
cwz_eikoh e6c6f66760 feat(llm): add llm-router-agent (#25149) 2026-07-15 15:32:45 +08:00
cwz_eikoh f3bc838d41 feat(llm): support llm-bench in llm (#25147) 2026-07-15 15:03:15 +08:00
Zexi Li 0d58ed4ccb feat(aiproxy): add OpenAI Responses API with provider adapters and Codex support (#25121) 
Implement /v1/responses endpoint with multi-provider translation (OpenAI, Azure,
Anthropic, Gemini), streaming compat layers, Codex config/tool integration, and
updated functional test docs.
 2026-07-10 16:40:42 +08:00
Zexi Li f538dcf2e6 feat(aiproxy): add Anthropic Messages API and migrate functional tests to Go (#25097) 
Add /v1/messages handler with Anthropic-to-OpenAI translation, upstream
failover, and probe endpoints. Replace shell-based functional test scripts
with pkg/aiproxy/ft and climc test commands; consolidate documentation.
 2026-07-07 20:13:03 +08:00
Zexi Li c91b5bc70c feat(llm): add ModelScope instant model import and refactor model download (#25091) 
Add ModelScope hub integration, download driver, and instant model import
flow parallel to HuggingFace. Extract shared HuggingFace download helpers
and reuse them across vLLM/SGLang container drivers.
 2026-07-01 20:12:59 +08:00
Zexi Li f1f3c1df2a feat(llm): support local_path scheduling with prefer_hosts and deployment restart (#25085) 2026-07-01 13:11:02 +08:00
Zexi Li 3413845e96 feat(llm): backfill orphan LLM instances into deployments on init (#25079) 
On service startup, find LLM instances without llm_deployment_id and
create a matching SLLMDeployment, then link the instance. Idempotent
across restarts; skipped on slave nodes.
 2026-06-29 11:26:16 +08:00
Zexi Liandcwz d3b4ab273a Automated cherry pick of #25074: feat(llm): tool call defaults & auto gpu ultilization (#25075) 
* feat(llm): upgrade auto-gpu-ultilization

* feat(llm): add vllm tool call defaults

* feat(llm): add sglang tool call defaults

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-06-26 10:15:55 +08:00
Zexi Li 686b0f3872 feat(llm): async instant model delete and improve import status tracking (#25072) 
fix(aiproxy): set OpenAI handler process timeouts and skip upstream error
response when request context is already cancelled.
 2026-06-25 19:52:28 +08:00
Zexi Li b52aa5de85 feat(llm): validate GPU devices on deployment create and improve error messages (#25062) 2026-06-24 14:26:18 +08:00
cwz_eikoh c3db76457d Automated cherry pick of #25016: Feature/http get+llm probe (#25045) 
* hostman: probe http get in pod netns

* llm: watch pod status for service readiness
 2026-06-23 19:40:46 +08:00
Zexi Li 4237ce52ea feat(llm): sync llm deployment with aiproxy catalog and routing (#25013) 
Add auto_register_aiproxy on llm_deployment creation, background sync task,
and register/unregister CLI actions. Link aiproxy providers, routings, and
models to llm replicas via llm_id and llm_deployment_id fields.
 2026-06-22 19:35:50 +08:00
cwz_eikoh d2bbda642b Automated cherry pick of #25044: Feature/llm route for aiproxy (#25046) 
* feat(aiproxy): support routing model in aiproxy

* feat(llm): add llm-router
 2026-06-22 10:09:58 +08:00
Zexi Li 81ebea9451 feat(llm): add community images catalog API (#25030) 
Expose llmimages.yaml as list/show/refresh endpoints with configurable
source URL, periodic cache refresh, and mcclient module support.
 2026-06-15 17:26:25 +08:00
屈轩 7cff45fb5b feat(aiproxy): add aiproxy (#25003) 2026-06-09 18:54:54 +08:00
Zexi Liandcwz 72d7bd23b4 Automated cherry pick of #24985: Feat/deployment hostpath (#24993) 
* feat(llm): hostpath support in deployment

* fix(llm): status error in deployment & sku deleted by deployment accidentally

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-06-08 11:23:48 +08:00
Zexi Li e42070a852 fix(llm): 更新 model catalog 默认 URL 与 webtop 镜像同步 (#24973) 
将 ModelCatalogURL 默认路径改为 model-catalog.yaml；
sync_llm_images 改为同步 fedora-xfce webtop 并注释其它候选镜像。
 2026-06-04 18:51:12 +08:00
Zexi Li a1ba61b875 fix(llm): container desktop (#24970) 2026-06-04 11:51:41 +08:00
Zexi Li e3fb9b2295 feat(llm): container desktop (#24961) 2026-06-03 13:24:53 +08:00
cwz_eikoh 28b9e2e155 Automated cherry pick of #24924: Feat/auto gpu ultilization (#24929) 
* fix(llm): support hf import llm_sku

* feat(llm): auto-gpu-memory-utilization
 2026-05-29 17:45:48 +08:00
Zexi Liandcwz d87805622e Automated cherry pick of #24885: Feature/download progress (#24909) 
* feat(llm): support download progress when model import

* fix(llm): unsupported catalog source \"ollama\" when model_set import llm_sku

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-05-27 13:20:54 +08:00
Zexi Li 4c0dd07a91 feat(llm,scheduler): vram calculation (#24884) 2026-05-25 16:27:20 +08:00
Zexi Liandcwz ecdf0e824f feat(llm): auto append backend_parameters in vllm & sglang (#24883) 
Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-05-22 17:02:18 +08:00
Zexi Liandcwz 7ed23c433d feat(hermes): connect vllm/sglang/ollama (#24863) 
Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-05-21 11:41:22 +08:00
Zexi Liandcwz c019216508 feat(llm): create llm_sku from llm_model_set (#24865) 
Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-05-21 11:40:37 +08:00
Zexi Liandcwz 383764dbb6 feat(llm): Implement resumable downloads for models from Hugging Face (#24859) 
Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-05-21 10:48:39 +08:00
Zexi Li 9775565a53 feat(llm): llm deployemnt (#24847) 2026-05-20 11:06:13 +08:00
Zexi Li d38b835f8e fix(llm): persistent /config dir of hermes agent (#24834) 2026-05-18 14:57:26 +08:00
Zexi Liandcwz 41a5d7aa3f feat(llm): support sglang (#24822) 
Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-05-14 17:07:37 +08:00
Zexi Liandcwz 520bab0dca Automated cherry pick of #24801: Feature(vllm): use entrypint instead of StartLLM (#24803) 
* feat(llm): use entrypoint instead of StartLLM

* feat(llm): adapt front-end in comfyui instant-model

---------

Co-authored-by: cwz <cwz_eikoh@163.com>
 2026-05-12 10:46:03 +08:00