Commit Graph
1551 Commits
Author SHA1 Message Date
myhloli 4c412b2878 (docs&build): switch to Aliyun PyPI mirror
- Update PyPI mirror from Tsinghua to Aliyun in multiple Dockerfiles and installation scripts
- This change may improve package download speed and reliability for users in China
2024-10-29 18:14:00 +08:00
Xiaomeng Zhao 37dd55c4e1 Merge pull request #806 from myhloli/dev
docs(README): update model download instructions for PDF-Extract-Kit 1.0
2024-10-28 18:28:05 +08:00
myhloli a9b6eb0093 docs(README): update model download instructions for PDF-Extract-Kit 1.0
- Update README.md and README_zh-CN.md to include new model download instructions
- Provide detailed steps on how to download models after PDF-Extract-Kit 1.0 repository change
- Emphasize the need to re-download models due to repository change
2024-10-28 18:27:11 +08:00
myhloli 247576c18e docs(README): update model download instructions for PDF-Extract-Kit 1.0
- Update README.md and README_zh-CN.md to include new model download instructions
- Provide detailed steps on how to download models after PDF-Extract-Kit 1.0 repository change
- Emphasize the need to re-download models due to repository change
2024-10-28 18:25:57 +08:00
Xiaomeng Zhao 03dd0cb9e6 Merge pull request #805 from myhloli/dev
refactor(table): disable StructEqTable support and add TableMaster support
2024-10-28 18:14:53 +08:00
myhloli 377b09cf8c refactor(table): disable StructEqTable support and add TableMaster support
- Remove import and usage of StructTableModel- Add support for TableMaster model- Update table model initialization logic to support TableMaster
- Log error and exit if StructEqTable is selected, as it's under upgrade
- Update README files to reflect changes in table parsing capabilities
2024-10-28 18:11:35 +08:00
Xiaomeng Zhao 3879bf8d09 Merge pull request #804 from icecraft/fix/match_figure_caption
fix: add priority match rule
2024-10-28 17:24:38 +08:00
icecraft 34a13a898b fix: add priority match rule 2024-10-28 17:21:50 +08:00
Xiaomeng Zhao 3a166bf13b Merge pull request #802 from papayalove/dev-table-model-update
perf: table model update with PP OCRv4
2024-10-28 17:19:45 +08:00
liukaiwen 4949408c9d perf: table model update with PP OCRv4 2024-10-28 17:09:46 +08:00
liukaiwen 7d2dfc8091 Merge branch 'dev' into dev-table-model-update 2024-10-28 16:36:32 +08:00
liukaiwen a0eff3be5c feat: table model update with paddle recognition v4 2024-10-28 16:34:16 +08:00
Kaiwen Liu 6d571e2e2c Merge pull request #7 from opendatalab/dev
Dev
2024-10-28 16:32:05 +08:00
Xiaomeng Zhao 37c335ae38 Update README.md 2024-10-28 16:13:10 +08:00
Xiaomeng Zhao 889c8a33b5 Update README.md 2024-10-28 16:12:11 +08:00
Xiaomeng Zhao 739134844b Merge pull request #800 from myhloli/dev
docs: update documentation path in README files
2024-10-28 15:28:18 +08:00
myhloli 75b4375dbd docs: update documentation path in README files
- Update image path in README.md and README_zh-CN.md
- Update chemical formula recognition link in README.md and README_zh-CN.md
2024-10-28 15:27:26 +08:00
Xiaomeng Zhao fc287b4b14 Merge pull request #799 from myhloli/update-docs
docs: update logo path in README files
2024-10-28 15:17:29 +08:00
myhloli 094f926494 docs: update logo path in README files
- Change the logo path from 'docs/images/MinerU-logo.png' to 'old_docs/images/MinerU-logo.png' in both README.md and README_zh-CN.md- This update ensures that the correct logo is displayed in the project's README files
2024-10-28 15:16:17 +08:00
Xiaomeng Zhao 92efd9a192 Merge pull request #798 from myhloli/update-docs
docs(README): update for v0.9.0 release
2024-10-28 15:05:50 +08:00
myhloli 05c3c95e53 docs(README): remove empty line in table-config example
- Delete unnecessary empty line in the table-config JSON example- Improve readability and formatting consistency in the configuration example
2024-10-28 15:05:15 +08:00
myhloli c3c91dc469 docs(README): update for v0.9.0 release
- Add changelog for v0.9.0 release with major refactoring and improvements
- Update key features list to include new functionalities
- Modify system requirements and hardware support information
- Add section for deploying derived projects
- Update known issues and TODO list
2024-10-28 15:02:19 +08:00
Xiaomeng Zhao bedefd8d78 Merge pull request #797 from icecraft/feat/new_table_caption_match
Feat/new table caption match
2024-10-28 14:20:20 +08:00
icecraft f09148b9bb fix: patter match algorithm 2024-10-28 13:47:39 +08:00
Xiaomeng Zhao d68b3d90b7 Merge pull request #794 from myhloli/update-docs
docs: update model download instructions and simplify demo scripts
2024-10-27 18:05:27 +08:00
myhloli 4cf7e9a224 refactor(pdf_parse): adjust block splitting logic for wide blocks
- Modify the logic for splitting wide blocks exceeding 0.4 page width
- Remove the specific case for blocks exceeding 0.25 page width
- Add comments to explain the reasoning behind different splitting strategies
2024-10-27 18:02:42 +08:00
myhloli acab8de50f docs: update model download instructions and simplify demo scripts
- Update model download instructions for versions 0.9.x and later
- Simplify demo scripts by removing unnecessary model configuration
- Add visualization function to draw bounding boxes
- Update CLI help message with new URL
2024-10-27 12:12:56 +08:00
Xiaomeng Zhao efb6b688db Merge pull request #793 from randydl/feat-multi-gpu
Add multi_gpu process project
2024-10-27 02:08:02 +08:00
Hui 78d1fb00e1 Add multi_gpu process project 2024-10-27 01:11:36 +08:00
Xiaomeng Zhao 460ea6b4ff Merge pull request #791 from myhloli/fix-imgs-block
feat(draw_bbox): update bounding box drawing for tables and images
2024-10-26 19:22:09 +08:00
myhloli 0e8d5893eb feat(draw_bbox): update bounding box drawing for tables and images
- Add support for drawing bounding boxes of table and image sub-blocks
- Implement sorting of table blocks based on type order
- Update bounding box drawing for text and title blocks
- Refactor code to handle different block types and their sub-blocks
2024-10-26 19:20:18 +08:00
Xiaomeng Zhao 7469697b5c Merge pull request #789 from myhloli/fix-imgs-block
fix: add init to magic_pdf.utils
2024-10-26 00:39:34 +08:00
myhloli 9cda7051c6 add init to magic_pdf.utils 2024-10-26 00:38:34 +08:00
Xiaomeng Zhao 0c03441df2 Merge pull request #788 from myhloli/fix-imgs-block
fix: add init to magic_pdf.config
2024-10-26 00:31:17 +08:00
myhloli 02b7999299 add init to magic_pdf.config 2024-10-26 00:30:30 +08:00
icecraft 969101ddf2 fix: uncorrect pair match 2024-10-25 20:44:17 +08:00
Xiaomeng Zhao d3d627cd53 Merge pull request #786 from myhloli/fix-imgs-block
refactor(ocr): adjust OCR processing parameters
2024-10-25 19:04:03 +08:00
myhloli 1807126e7f refactor(ocr): adjust OCR processing parameters
- Lower the Y-axis overlap threshold for merging spans into lines from0.6 to 0.5
- Reduce the unclip ratio for OCR detection from 2.4 to 1.8
2024-10-25 19:03:03 +08:00
Xiaomeng Zhao 25a6d4baeb Merge pull request #785 from myhloli/fix-imgs-block
refactor(parse_core): improve image and table block handling
2024-10-25 17:30:33 +08:00
myhloli c34c9d21ef refactor(ocr): improve image and table block handling
- Split image and table blocks into separate categories
- Add group_id to image and table blocks- Update block processing logic to handle new categories
- Modify layout splitting and span filling to accommodate new block types
- Adjust block indexing and sorting to consider new structures
2024-10-25 17:26:14 +08:00
Xiaomeng Zhao c3cdf6f8e1 Merge pull request #784 from icecraft/feat/new_table_caption_match
Feat/new table caption match
2024-10-25 16:08:36 +08:00
icecraft 2c60172b83 feat: update return result 2024-10-25 15:58:09 +08:00
icecraft 92579040c4 feat: update table match caption algorithm 2024-10-25 15:55:47 +08:00
myhloli ce72cf05cb refactor(magic_pdf): adjust confidence threshold for DocLayout_YOLO model
- Changed the confidence threshold from0.15 to 0.25 in the DocLayout_YOLO model prediction
- This adjustment aims to improve the accuracy of layout detection by filtering out low-confidence predictions
2024-10-24 14:13:32 +08:00
Xiaomeng Zhao 82dd7ac5bf Merge pull request #782 from icecraft/feat/data_api
Feat/data api
2024-10-24 11:37:09 +08:00
icecraft c200effc3a style: remove unsed log info 2024-10-24 11:14:31 +08:00
icecraft bb1799541d feat: update docs deps 2024-10-24 11:09:30 +08:00
icecraft 283b597a6e feat: add [figure | table] match [caption | footnote] match algorithm v2
feat: add Data api
2024-10-24 10:50:04 +08:00
Xiaomeng Zhao e36627beee Merge pull request #777 from myhloli/add-doclayout-yolo
feat: add support for non-PDF file conversion to PDF
2024-10-23 19:46:51 +08:00
myhloli 4834baf4ba feat: add support for non-PDF file conversion to PDF
- Implement to_pdf function to convert non-PDF files to PDF format
- Integrate file upload functionality for PDF and image files- Update UI to include file upload component and PDF preview
- Add conversion button and update its functionality to handle new file types
2024-10-23 19:29:31 +08:00