mirror of
https://github.com/xming521/WeClone.git
synced 2026-08-28 18:07:28 +08:00
feat(dataset): handle image data in LLM cleaning
Updates pre-commit hooks. Previously, the cleaning pipeline was entirely disabled for datasets containing image messages. Image conversations now receive a default score, bypassing text-focused LLM cleaning. This enables partial cleaning for mixed datasets and prevents pipeline failures.
This commit is contained in:
@@ -9,7 +9,7 @@ ci:
|
||||
|
||||
repos:
|
||||
- repo: https://github.com/pre-commit/pre-commit-hooks
|
||||
rev: v5.0.0
|
||||
rev: v6.0.0
|
||||
hooks:
|
||||
- id: check-ast # Python 语法检查
|
||||
- id: check-added-large-files # 防止大文件
|
||||
@@ -27,7 +27,7 @@ repos:
|
||||
args: ["--fix=lf"]
|
||||
|
||||
- repo: https://github.com/astral-sh/ruff-pre-commit
|
||||
rev: v0.12.7
|
||||
rev: v0.12.8
|
||||
hooks:
|
||||
- id: ruff
|
||||
args: [--fix]
|
||||
|
||||
Reference in New Issue
Block a user