diff --git a/README.md b/README.md index ac15859..2157c41 100644 --- a/README.md +++ b/README.md @@ -78,7 +78,7 @@ - [x] [GLM-4.1V-Thinking vLLM 部署调用](./models/GLM-4.1V-Thinking/01-GLM-4%201V-Thinking%20vLLM部署调用.md) @林恒宇 - [x] [GLM-4.1V-Thinking Gradio部署](./models/GLM-4.1V-Thinking/02-GLM-4%201V-Thinking%20Gradio部署.md) @林恒宇 - [x] [GLM-4.1V-Thinking Lora 微调及 SwanLab 可视化记录](./models/GLM-4.1V-Thinking/03-GLM-4%201V-Thinking%20LoRA%20及%20SwanLab%20可视化记录.md) @林恒宇 - - [x] [GLM-4.1V-Thinking Docker 镜像]() @林恒宇 + - [x] [GLM-4.1V-Thinking Docker 镜像](https://www.codewithgpu.com/i/datawhalechina/self-llm/GLM4.1V-Thinking-lora) @林恒宇 - [GLM-4.5-Air](https://github.com/zai-org/GLM-4.5) - [x] [GLM-4.5-Air vLLM 部署调用](./models/GLM-4.5-Air/01-GLM-4.5-Air-vLLM%20部署调用.md) @不要葱姜蒜 diff --git a/models/GLM-4.1V-Thinking/01-GLM-4 1V-Thinking vLLM部署调用.md b/models/GLM-4.1V-Thinking/01-GLM-4 1V-Thinking vLLM部署调用.md index 164f09b..0dafce2 100644 --- a/models/GLM-4.1V-Thinking/01-GLM-4 1V-Thinking vLLM部署调用.md +++ b/models/GLM-4.1V-Thinking/01-GLM-4 1V-Thinking vLLM部署调用.md @@ -126,11 +126,11 @@ print(f"Assistant: {raw}") 使用的视频文件示例: -[demo3.mp4](images/demo3.mp4) +[vdieo-1.mp4](images/vdieo-1.mp4) 执行代码结果如下: -![54022834-6a29-417b-9e3a-a9745ed94ae9.png](images/54022834-6a29-417b-9e3a-a9745ed94ae9.png) +![image-2.png](images/image-2.png) ``` Assistant: 用户现在需要描述视频内容。首先看画面:主要是Logi品牌的键盘,有手在操作按键。要分解每个细节:键盘是黑色带银色上沿,有数字键、功能键(如ins、delete、home等),手部动作是点击不同按键(比如数字键、功能键),背景有桌面、耳机(白色耳机和黑色耳机线),还有其他物品。需要按时间顺序或场景描述,说明是手在键盘上操作,按键的交互,以及环境元素。 @@ -191,7 +191,7 @@ print(outputs[0].outputs[0].text) 执行代码结果如下: -![f1bbc211-9869-4f55-81fc-9f124c229bd3.png](images/f1bbc211-9869-4f55-81fc-9f124c229bd3.png) +![image-3.png](images/image-3.png) GLM-4.1V-9B-Thinking支持多种类型的多模态输入,但有特定限制: @@ -224,7 +224,7 @@ vllm serve /root/autodl-tmp/ZhipuAI/GLM-4.1V-9B-Thinking --allowed-local-media-path / ``` -![f2dc28ba-6eb9-42bb-a936-8eb548d13b38.png](images/f2dc28ba-6eb9-42bb-a936-8eb548d13b38.png) +![image-4.png](images/image-4.png) - 通过 `curl` 命令查看当前的模型列表 @@ -282,7 +282,7 @@ curl http://localhost:8000/v1/completions \ 得到的返回值如下所示 -![f11a6076-136c-4ddc-9e9b-34b614ac56f9.png](images/f11a6076-136c-4ddc-9e9b-34b614ac56f9.png) +![image-5.png](images/image-5.png) • 用 `Python` 脚本请求 `OpenAI Chat Completions API` 的单图像示例 @@ -349,11 +349,11 @@ print(response.choices[0].message.content.strip()) 示例使用的图像如下所示: -![demo1.png](images/demo1.png) +![image-6.png](images/image-6.png) 得到的结果如下所示: -![7e5358f9-3e86-4d92-b304-5b6e59ddd2b0.png](images/7e5358f9-3e86-4d92-b304-5b6e59ddd2b0.png) +![image-7.png](images/image-7.png) • 用 `Python` 脚本请求 `OpenAI Chat Completions API` 的多图像分析 @@ -379,8 +379,8 @@ messages = [ 示例使用的图像如下所示:
- demo2-1 - demo2-2 + image-8 + image-9
执行代码结果如下: diff --git a/models/GLM-4.1V-Thinking/02-GLM-4 1V-Thinking Gradio部署.md b/models/GLM-4.1V-Thinking/02-GLM-4 1V-Thinking Gradio部署.md index 95872a7..2113a56 100644 --- a/models/GLM-4.1V-Thinking/02-GLM-4 1V-Thinking Gradio部署.md +++ b/models/GLM-4.1V-Thinking/02-GLM-4 1V-Thinking Gradio部署.md @@ -2,7 +2,7 @@ THUDM也提供一个gradio界面脚本,搭建一个可以直接使用的 Web 界面,支持图片,视频,PDF,PPT等多模态输入。当然,如果glm4.1v在本地调用的及修改对应的模型路径即可。 -![5b6cb0ad-cd47-451c-9f12-fda3e8300842.png](images/5b6cb0ad-cd47-451c-9f12-fda3e8300842.png) +![image-10.png](images/image-10.png) ```bash python /root/autodl-tmp/GLM-4.1V-Thinking/inference/trans_infer_gradio.py @@ -16,10 +16,10 @@ ssh -F /dev/null -CNg -L 7860:127.0.0.1:7860 [root@connect.nma1.seetacloud.com]( ## 启动示例 -![4cfaea13-f4c7-4a95-b6a3-1ab88794f204.png](images/4cfaea13-f4c7-4a95-b6a3-1ab88794f204.png) +![image-11.png](images/image-11.png) -![7146cb1a-1e79-41b8-8927-62b1ae054cff.png](images/7146cb1a-1e79-41b8-8927-62b1ae054cff.png) +![image-12.png](images/image-12.png) -![5d1abd7a-f6f1-480e-8613-6e7e4d65734b.png](images/5d1abd7a-f6f1-480e-8613-6e7e4d65734b.png) +![image-13.png](images/image-13.png) -![4d52e632-038f-487b-ae36-c59f2e3d0481.png](images/4d52e632-038f-487b-ae36-c59f2e3d0481.png) \ No newline at end of file +![image-14.png](images/image-14.png) \ No newline at end of file diff --git a/models/GLM-4.1V-Thinking/03-GLM-4 1V-Thinking LoRA 及 SwanLab 可视化记录.md b/models/GLM-4.1V-Thinking/03-GLM-4 1V-Thinking LoRA 及 SwanLab 可视化记录.md index 044d1a3..2fa90af 100644 --- a/models/GLM-4.1V-Thinking/03-GLM-4 1V-Thinking LoRA 及 SwanLab 可视化记录.md +++ b/models/GLM-4.1V-Thinking/03-GLM-4 1V-Thinking LoRA 及 SwanLab 可视化记录.md @@ -152,7 +152,7 @@ swanlab_callback = SwanLabCallback( 训练完成后可以看到自己训练过程中训练的相关参数曲线 -![af070e5a-5ff2-472a-8d17-31c3be798a60.png](images/af070e5a-5ff2-472a-8d17-31c3be798a60.png) +![image-15.png](images/image-15.png) ## 加载LoRA模型推理 @@ -249,6 +249,6 @@ print(output_text) `喵呜~这个皮革看起来很舒服喵!就像本雪的毛一样柔软喵~你觉得呢喵?本雪想摸一摸喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)喵~(蹭蹭)喵~(舔毛)喵~(打滚)喵~(摇尾巴)喵~(喵喵叫)喵~(跳起来)喵~(扑过去)` -![0a142a95-2ae7-4048-b08a-70b9d4135b21.png](images/0a142a95-2ae7-4048-b08a-70b9d4135b21.png) +![image-16.png](images/image-16.png) hhhhh \ No newline at end of file diff --git a/models/GLM-4.1V-Thinking/images/5b6cb0ad-cd47-451c-9f12-fda3e8300842.png b/models/GLM-4.1V-Thinking/images/image-10.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/5b6cb0ad-cd47-451c-9f12-fda3e8300842.png rename to models/GLM-4.1V-Thinking/images/image-10.png diff --git a/models/GLM-4.1V-Thinking/images/4cfaea13-f4c7-4a95-b6a3-1ab88794f204.png b/models/GLM-4.1V-Thinking/images/image-11.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/4cfaea13-f4c7-4a95-b6a3-1ab88794f204.png rename to models/GLM-4.1V-Thinking/images/image-11.png diff --git a/models/GLM-4.1V-Thinking/images/7146cb1a-1e79-41b8-8927-62b1ae054cff.png b/models/GLM-4.1V-Thinking/images/image-12.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/7146cb1a-1e79-41b8-8927-62b1ae054cff.png rename to models/GLM-4.1V-Thinking/images/image-12.png diff --git a/models/GLM-4.1V-Thinking/images/5d1abd7a-f6f1-480e-8613-6e7e4d65734b.png b/models/GLM-4.1V-Thinking/images/image-13.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/5d1abd7a-f6f1-480e-8613-6e7e4d65734b.png rename to models/GLM-4.1V-Thinking/images/image-13.png diff --git a/models/GLM-4.1V-Thinking/images/4d52e632-038f-487b-ae36-c59f2e3d0481.png b/models/GLM-4.1V-Thinking/images/image-14.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/4d52e632-038f-487b-ae36-c59f2e3d0481.png rename to models/GLM-4.1V-Thinking/images/image-14.png diff --git a/models/GLM-4.1V-Thinking/images/af070e5a-5ff2-472a-8d17-31c3be798a60.png b/models/GLM-4.1V-Thinking/images/image-15.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/af070e5a-5ff2-472a-8d17-31c3be798a60.png rename to models/GLM-4.1V-Thinking/images/image-15.png diff --git a/models/GLM-4.1V-Thinking/images/0a142a95-2ae7-4048-b08a-70b9d4135b21.png b/models/GLM-4.1V-Thinking/images/image-16.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/0a142a95-2ae7-4048-b08a-70b9d4135b21.png rename to models/GLM-4.1V-Thinking/images/image-16.png diff --git a/models/GLM-4.1V-Thinking/images/54022834-6a29-417b-9e3a-a9745ed94ae9.png b/models/GLM-4.1V-Thinking/images/image-2.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/54022834-6a29-417b-9e3a-a9745ed94ae9.png rename to models/GLM-4.1V-Thinking/images/image-2.png diff --git a/models/GLM-4.1V-Thinking/images/f1bbc211-9869-4f55-81fc-9f124c229bd3.png b/models/GLM-4.1V-Thinking/images/image-3.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/f1bbc211-9869-4f55-81fc-9f124c229bd3.png rename to models/GLM-4.1V-Thinking/images/image-3.png diff --git a/models/GLM-4.1V-Thinking/images/f2dc28ba-6eb9-42bb-a936-8eb548d13b38.png b/models/GLM-4.1V-Thinking/images/image-4.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/f2dc28ba-6eb9-42bb-a936-8eb548d13b38.png rename to models/GLM-4.1V-Thinking/images/image-4.png diff --git a/models/GLM-4.1V-Thinking/images/f11a6076-136c-4ddc-9e9b-34b614ac56f9.png b/models/GLM-4.1V-Thinking/images/image-5.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/f11a6076-136c-4ddc-9e9b-34b614ac56f9.png rename to models/GLM-4.1V-Thinking/images/image-5.png diff --git a/models/GLM-4.1V-Thinking/images/demo1.png b/models/GLM-4.1V-Thinking/images/image-6.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/demo1.png rename to models/GLM-4.1V-Thinking/images/image-6.png diff --git a/models/GLM-4.1V-Thinking/images/7e5358f9-3e86-4d92-b304-5b6e59ddd2b0.png b/models/GLM-4.1V-Thinking/images/image-7.png similarity index 100% rename from models/GLM-4.1V-Thinking/images/7e5358f9-3e86-4d92-b304-5b6e59ddd2b0.png rename to models/GLM-4.1V-Thinking/images/image-7.png diff --git a/models/GLM-4.1V-Thinking/images/demo2-1.jpg b/models/GLM-4.1V-Thinking/images/image-8.jpg similarity index 100% rename from models/GLM-4.1V-Thinking/images/demo2-1.jpg rename to models/GLM-4.1V-Thinking/images/image-8.jpg diff --git a/models/GLM-4.1V-Thinking/images/demo2-2.jpg b/models/GLM-4.1V-Thinking/images/image-9.jpg similarity index 100% rename from models/GLM-4.1V-Thinking/images/demo2-2.jpg rename to models/GLM-4.1V-Thinking/images/image-9.jpg diff --git a/models/GLM-4.1V-Thinking/images/demo3.mp4 b/models/GLM-4.1V-Thinking/images/vdieo-1.mp4 similarity index 100% rename from models/GLM-4.1V-Thinking/images/demo3.mp4 rename to models/GLM-4.1V-Thinking/images/vdieo-1.mp4