feat(dataset): handle image data in LLM cleaning

Updates pre-commit hooks.

Previously, the cleaning pipeline was entirely disabled for datasets

containing image messages.

Image conversations now receive a default score, bypassing text-focused

LLM cleaning. This enables partial cleaning for mixed datasets and

prevents pipeline failures.
This commit is contained in:
xming521
2025-08-11 11:03:14 +08:00
parent a05bb7e856
commit 6b134ea703
3 changed files with 13 additions and 14 deletions
+2 -2
View File
@@ -9,7 +9,7 @@ ci:
repos:
- repo: https://github.com/pre-commit/pre-commit-hooks
rev: v5.0.0
rev: v6.0.0
hooks:
- id: check-ast # Python 语法检查
- id: check-added-large-files # 防止大文件
@@ -27,7 +27,7 @@ repos:
args: ["--fix=lf"]
- repo: https://github.com/astral-sh/ruff-pre-commit
rev: v0.12.7
rev: v0.12.8
hooks:
- id: ruff
args: [--fix]