132 Commits
Author SHA1 Message Date
myhloli dba28389bc refactor(model): update model downloads and disable unused models
- Comment out LayoutLMv3, TableMaster, and StructEqTable models
- Update MFR model path to unimernet_hf_small_2503- Remove unused import in Unimernet.py
2025-03-21 11:19:03 +08:00
JesseChen1031 2bdb544553 update api path and documents 2025-03-14 14:31:46 +08:00
JesseChen1031 102fe27777 add support for more document types 2025-03-14 12:07:16 +08:00
Xiaomeng Zhao 08dd3a85a8 Merge pull request #1743 from xuzijie1995/master
Updata ext.py is_pdf function to support the pdf with Chinese characters and special characters
2025-02-24 10:44:27 +08:00
sayThQ199 034034c6e0 Update ext.py
Determine whether the file name with a.pdf extension supports the inclusion of special characters or Chinese characters.
2025-02-22 14:24:50 +08:00
shniubobo d9406e5bd6 docs(web_api): Update README.md 2025-02-14 18:59:59 +00:00
shniubobo acd0deb1e2 docs(web_api): Change docstrings style 2025-02-14 18:41:50 +00:00
shniubobo 3b98efbb3d feat(web_api): Return images in api 2025-02-14 18:37:54 +00:00
shniubobo 635418b6bd feat(web_api)!: Make is_json_md_dump default to False 2025-02-14 17:44:36 +00:00
shniubobo 792e08cfb2 fix(web_api): Disallow both pdf_file and pdf_path
Also add some documentation.
2025-02-14 17:35:40 +00:00
shniubobo 69e0e00e26 refactor(web_api): Format code 2025-02-14 17:12:10 +00:00
shniubobo c734f4debe refactor(web_api): Optimize Dockerfile 2025-02-14 17:07:46 +00:00
utopia2077 f559fd9c36 refactor(web_api): adapt to new pipeline API changes 2025-02-14 17:00:28 +00:00
myhloli af4b209ee7 docs(url): update Miners links in header
- Change Miners homepage link from 'https://mineru.org.cn/home?source=online' to 'https://mineru.net/home?source=online'
- Change Miners client download link from 'https://mineru.org.cn/client?source=online' to 'https://mineru.net/client?source=online'
2025-01-22 18:28:24 +08:00
myhloli 2a3a006f4d fix(models): update unimernet_small model path
- Update model path from 'unimernet_small' to 'unimernet_small_2501' in multiple scripts and configuration files
- This change affects download_models.py, download_models_hf.py, and model_configs.yaml
2025-01-21 16:29:29 +08:00
icecraft 17eba957e7 fix: fix import path 2025-01-13 14:20:16 +08:00
Hui Kang 0160e5d265 Relocate magic_pdf imports to setup to Ensure Proper CUDA Initialization 2025-01-13 12:19:53 +08:00
Hui 667d2c0d55 Adjust projects/multi_gpu/server.py for magic_pdf-1.0.1 2025-01-13 01:39:01 +08:00
myhloli d2228fb93f feat(header): update homepage link and add client download link
- Update homepage link to point to https://mineru.org.cn/home
- Add client download link for users to easily access the app- Change globe icon to home icon for homepage
2025-01-10 11:21:18 +08:00
myhloli 364b46df8c feat(header): update homepage link and add client download link
- Update homepage link to point to https://mineru.org.cn/home
- Add client download link for users to easily access the app- Change globe icon to home icon for homepage
2025-01-10 11:18:20 +08:00
myhloli 2107b25eab feat: set 'auto' as default language value
- Change the default value of the language dropdown from an empty string to 'auto'
- This ensures a language is always selected by default, improving
2025-01-09 18:17:32 +08:00
myhloli f5f356334b fix(clear_bu): remove language selection from clear button
- Update clear_bu.add() to exclude 'language' input
2025-01-09 17:59:53 +08:00
myhloli a80ff05150 refactor(model): remove unused YOLO v11 language detection model
- Remove YOLO v11 language detection model from model_configs.yaml
- Update language detection utils to use a fixed model path instead of dynamic configuration
- Remove unused model weight parameter for YOLO v11 language detection
2025-01-09 17:14:20 +08:00
myhloli b06a1f2ba2 update example 2025-01-09 16:38:58 +08:00
myhloli e3d2de3710 fix(clear_bu): remove unused input from clear button
Remove 'table_enable' input from the clear button's function call. This change ensures that only necessary inputs are included in the clear operation, improving code efficiency and maintainability.
2025-01-07 10:59:04 +08:00
myhloli bdfdfea6f8 feat: enable table recognition by default- Set table recognition to enabled by default in the UI
- Change default layout model to 'doclayout_yolo'- Enable table recognition in the magic-pdf template
2025-01-06 20:40:30 +08:00
Xiaomeng Zhao 8a0aa7a479 Merge branch 'dev' into dev 2025-01-06 18:11:44 +08:00
myhloli 16a0a350ae fix(magic-pdf): update OCR model selection logic
- Add missing 'else' statement in OCR model selection logic
- Ensure consistent formatting of 'if' statements for better readability
- Remove unnecessary empty line in the 'app.py' file
2025-01-05 17:45:31 +08:00
yzz 05109c3641 fix(web_api): Modify the import path of InferenceResult 2025-01-03 15:50:06 +08:00
myhloli bf2ff5a241 feat(gradio-app): improve PDF conversion and UI functionalities
- Add automatic conversion of uploaded files to PDF
- Update max page slider range and default value- Prevent interaction with PDF preview to avoid errors
- Increase Markdown rendering height for better visibility
- Update file change event handling for PDF conversion
- Modify supported image suffixes for file upload
2024-12-18 19:07:15 +08:00
myhloli 20438bd2b7 feat(language-detection): add YOLOv11 language detection model
- Add YOLOv11 language detection model for PDF documents
- Implement language detection in PymuDocDataset
- Update app.py to include 'auto' language option
- Create language detection utilities and constants
2024-12-17 19:06:50 +08:00
icecraft 440fd0c75b fix: projects 2024-12-12 16:52:27 +08:00
myhloli 012a46e07d refactor(magic-pdf): optimize model initialization and concurrency control
- Remove concurrency limit logic from app.py
- Update model initialization process in various modules
- Remove unused VRAM check for concurrency limit
- Refactor OCR model initialization in pdf_extract_kit.py
- Update txt_spans_extract_v2 function to use lang parameter instead of ocr_model
2024-12-06 20:35:43 +08:00
myhloli 104273cc79 fix(vram): improve VRAM checking logic
- Update VRAM checking logic in app.py and model_utils.py
- Add None and type checks for VRAM values
- Adjust concurrency limit calculation in app.py
- Modify clean_vram function to handle cases with no VRAM information
2024-12-03 14:22:35 +08:00
myhloli b1fe9d4f60 feat(gradio_app): implement dynamic concurrency limit based on VRAM
- Add get_concurrency_limit function to calculate concurrency limit based on VRAM
- Update clean_vram function and rename to get_vram for better clarity
- Apply concurrency limit to the to_markdown function in the Gradio app
2024-12-03 11:44:25 +08:00
houlinfeng f11f3d6032 fix: 修复文件名错误 2024-11-30 16:52:03 +08:00
icecraft b1adde8e66 fix: rewrite projects/ and demos with new data api 2024-11-24 16:06:55 +08:00
icecraft fa3c453c93 fix: use concrete class instead of abstract class 2024-11-21 18:34:41 +08:00
icecraft 6a481320ea fix: using new data api replace old rw api 2024-11-18 17:03:53 +08:00
houlinfeng aed0941fbf fix: 修复issue #715 2024-11-15 20:24:10 +08:00
myhloli 8ea2381334 style(gradio-app): add missing file type in upload
- Add missing '.jpg' file type to the list of allowed file types for upload
2024-11-08 18:31:32 +08:00
houlinfeng bd3d867d64 feat: 接口文档替换为链接 2024-11-05 20:15:55 +08:00
myhloli 4c412b2878 (docs&build): switch to Aliyun PyPI mirror
- Update PyPI mirror from Tsinghua to Aliyun in multiple Dockerfiles and installation scripts
- This change may improve package download speed and reliability for users in China
2024-10-29 18:14:00 +08:00
Hui 78d1fb00e1 Add multi_gpu process project 2024-10-27 01:11:36 +08:00
myhloli 4834baf4ba feat: add support for non-PDF file conversion to PDF
- Implement to_pdf function to convert non-PDF files to PDF format
- Integrate file upload functionality for PDF and image files- Update UI to include file upload component and PDF preview
- Add conversion button and update its functionality to handle new file types
2024-10-23 19:29:31 +08:00
myhloli 1279f2cd0f feat(model): add support for DocLayout-YOLO model
- Add new layout model option: DocLayout-YOLO
- Implement model initialization and prediction for DocLayout-YOLO
- Update configuration options to include new model- Modify existing code to support both LayoutLMv3 and DocLayout-YOLO models
- Update Gradio app to support more Custom Switch
2024-10-23 17:07:39 +08:00
myhloli cf377ce4a1 update example files 2024-10-16 16:21:25 +08:00
myhloli a71db70314 feat: add arXiv paper link to header and adjust PDF parsing logic- Add arXiv paper link to the header template for easy access to the latest research paper.
- Modify the PDF parsing logic to handle edge cases more accurately, particularly in determining the number of lines in a block based on its height.
2024-10-08 11:35:04 +08:00
sfk 9c38c88039 Update README_zh-CN.md 2024-09-27 16:44:11 +08:00
myhloli 39873969b0 docs: update project lists in README files to include web_api
Add the web_api project to the lists of projects in both the English and Chinese
README.md files, providing a brief description and linking to the project's
documentation. Ensure that the formatting and style are consistent with the
existing project entries.
2024-09-27 16:11:15 +08:00