32 Commits
Author SHA1 Message Date
myhloli 28494e633c refactor(api): unify task file fields and generate optional client IDs 2026-10-23 11:53:26 +08:00
myhloli 7f250e2331 feat(api)!: make Tasks the only asynchronous parsing API
Converge the SDK, Gradio, remote CLI, Doclib and Router on Tasks with hash-based uploads, per-file result URLs, task listing and optional model output. Preserve Files and the synchronous file_parse wrapper while removing standalone Uploads/Jobs and local-path HTTP inputs.

Migrate contract, lifecycle, transport and real-document regression coverage; update documentation and HTTP examples. Validation: 1452 passed, 3 conditional skips, plus targeted final PDF checks.

BREAKING CHANGE: clients and workers must use Tasks; standalone Uploads/Jobs endpoints and local-source/inline HTTP options have been removed.
2026-10-22 21:39:42 +08:00
myhloli bea1f6fac0 feat(tiers): extend file type normalization to include MHTML/MHT and update parsing rules 2026-09-24 01:58:17 +08:00
myhloli 7ac43b362b docs(next): reference effort_for_tier() instead of renamed mapping
HYBRID_EFFORT_BY_TIER 已改名为私有 _EFFORT_BY_TIER,公开入口是
effort_for_tier();workflows 不变量 #5 与 pitfalls §1.1 同步改用
公开 API 描述。docs/plans/ 带日期的历史设计记录保持原样。

Refs #5528
2026-09-18 19:52:00 +08:00
myhloli 6a2aec38b1 docs(next): drop stale backend references after removal
backend_for_tier 派生链与 ParserRuntimeOptions.backend 已随 dd20bf0
删除,同步清理设计文档残留:sdk/parser.md 导出表删行;glossary §3.2
改写为「backend 概念整体移除,现行只有 tier 及派生 effort」;
workflows 不变量 #5/#8、pitfalls §1.1 同步改写;structured-content-schema
删去已失效的 parse.backend 开放问题;implementation-plan 的
normalize_middle_json 任务卡去掉 backend 参数与 _meta.backend 迁移目标
(schema 2.0 不记录 backend)。mineru.backend 模块仍存在,
sdk/README.md 对应行保持不变。

Refs #5528
2026-09-18 19:37:11 +08:00
myhloli 2066dc6273 feat: remove --backend option from mineru-kit parse command and update documentation 2026-09-17 18:44:00 +08:00
myhloli 366fadb1c9 Promote TSV to an independent file suffix (ADR-0034)
- Route tsv through the shared CSV flash pipeline with an independent
  file_type and metadata.file_suffix; bump docvortex pin to 0.4.9
- Add ADR-0034 documenting the content-addressed cache identity decision,
  annotate ADR-0028, and update docs/next tier-group wording, telemetry
  and e2e specs
- Cover detection, sync/async analyze, API server jobs and doclib
  lifecycle for tsv in tests
2026-09-16 17:55:07 +08:00
myhloli dcc69e4e9b fix: update page range syntax from '~' to '-' across documentation and codebase 2026-09-04 11:48:37 +08:00
Luban b2db09fb5a Merge remote-tracking branch 'origin/next' into agent/luban/b644fe838c78-root
# Conflicts:
#	docs/next/open-questions.md
#	docs/next/roadmap.md
2026-09-02 10:10:03 +08:00
Lubanandmultica-agent d2a689d826 docs(next): fix adjudicated drift in root docs and CLAUDE.md install extras
Co-authored-by: multica-agent <github@multica.ai>
2026-09-01 18:54:47 +08:00
8e7206d70e docs(next): drift-fix batch 1 — A/B-tier status upgrades, default tier order, schema_version 2.0
- Upgrade 12 drift-free topic docs to Implemented and mark 20 audited
  ADRs as Accepted/implemented (with B-tier touch-ups first).
- B-tier fixes: ADR-0003 doc_ref= param, ADR-0004 SDK naming
  (DoclibClient.ensure_parse/list_parses/get_parse/get_doc_content/
  invalidate), ADR-0020 parse_server_*_logs classification, ADR-0021
  remove stale contradicted sentence, ADR-0022 EPUB matrix rows,
  ADR-0027 image_url branch note; structured-content-current.md notes
  ContentTypeV2 vocabulary still used by Content List V2.
- Unify default quality tier selection order to standard -> basic
  (parsing rules: standard -> basic -> flash); cached read order
  (advanced -> standard -> basic) unchanged.
- Unify Middle JSON schema_version to 2.0 and correct the legacy
  migration narrative: pdf_info/1.0 pages are runtime-converted by
  ParseResult.from_dict()/doclib compaction, while bare unversioned
  pages payloads are rejected.

Refs: Multica issue MINERU-10 (docs/next drift audit batch 1)

Co-Authored-By: Claude <noreply@anthropic.com>
Co-authored-by: multica-agent <github@multica.ai>
2026-09-01 18:12:11 +08:00
myhloli b67bbd49c9 feat: add OFD document parsing support and update Middle JSON schema to 3.0 2026-08-28 18:35:53 +08:00
myhloli b39de7d54d feat: refine page range handling for PDF and non-PDF inputs, ensuring only PDF supports explicit ranges 2026-08-26 19:50:40 +08:00
myhloli e8ae64a85a feat: add native EPUB parsing support and update documentation 2026-08-26 15:45:51 +08:00
myhloli 5dd63a602a feat: add support for CSV file parsing and update documentation 2026-08-26 11:36:21 +08:00
jinzhenj fbf08ebea0 feat: use new backend and render 2026-08-25 11:04:03 +08:00
jinzhenj 57aa965d41 refactor: rename parsing tiers 2026-07-21 12:28:30 +08:00
jinzhenj 0f75725741 feat(doclib): add visual block locators 2026-07-21 11:28:14 +08:00
jinzhenj c622f21545 Clarify text file handling in doclib 2026-07-17 15:28:16 +08:00
jinzhenj 4b59960e98 Align search results with file aliases 2026-07-11 00:53:08 +08:00
jinzhenj be3f35c0b1 Align tier docs and API contracts 2026-07-10 11:33:50 +08:00
jinzhenj 95893edf36 Refactor tier defaults and file type policy 2026-07-09 19:37:36 +08:00
jinzhenj fdfc592c27 feat: migrate docs 2026-07-08 16:59:37 +08:00
myhloli 329e240fc6 feat: update tier system to replace standard and pro with medium and high across documentation and codebase 2026-07-06 18:55:35 +08:00
myhloli ec8c462d15 feat: update backend references from pipeline to hybrid and adjust related documentation 2026-07-02 17:55:53 +08:00
jinzhenj 306a437bcd feat: several updates 2026-06-26 15:59:54 +08:00
myhloli 7dcc429dbb feat: replace content_list_v2 with structured_content and update related functions and documentation 2026-06-25 11:54:36 +08:00
jinzhenj 5181a07b0b feat: adjust configures 2026-06-18 14:04:28 +08:00
jinzhenj 832031a147 feat: many new features 2026-06-17 13:50:08 +08:00
jinzhenj 862b36d7ac feat: many features 2026-06-16 13:38:41 +08:00
jinzhenj dd94c21486 refactor doclib CLI API contracts 2026-06-15 11:31:25 +08:00
jinzhenj 04efa7531b feat: many features 2026-06-12 18:21:27 +08:00