Commit Graph
1183 Commits
Author SHA1 Message Date
myhloli d3e42e0845 docs: update URLs to gitee for Windows CUDA acceleration guides
Update the URLs for downloading the `magic-pdf.template.json` and `small_ocr.pdf`
files in the Windows CUDA acceleration guides. The links now point to the giteerepository instead of GitHub, ensuring users have access to the necessary files
from the correct source.
2024-08-06 19:01:59 +08:00
myhloli 020602ebfa docs(zh_CN): update Ubuntu CUDA Acceleration guide
- Streamline the installation process by removing the redundant apt update step.
- Adjust the numbering of installation steps throughout the document.
- Update download URLs to gitee for the configuration template and demo file.
- Ensure consistency in the model directory configuration advice.
2024-08-06 17:36:54 +08:00
myhloli 4d7dc06525 docs: add Ubuntu 22.04 LTS CUDA acceleration setup guide
Add a new README_Ubuntu_CUDA_Acceleration_en_US.md document to provide users with a
setup guide for enabling and testing CUDA acceleration on Ubuntu 22.04 LTS. The guideincludes steps to check and install NVIDIA drivers, install Anaconda, create a conda
environment, install required applications, download and verify models, configure theenvironment, and test CUDA acceleration.

This addition addresses the need for clear, concise instructions on achieving better
performance with CUDA-enabled graphics cards and
2024-08-06 17:26:53 +08:00
myhloli 2eaa9ca1d3 docs(FAQ): update troubleshooting sections for offline deployment and Mac issues
- Note the fix in version 0.6.2b1 for the network error during the first run of offline  deployment and clarify the model download requirement.
- Update the dependency installation guide for users on macOS with Intel CPUs.
- Indicate the resolution in version 0.6.2b1 for compatibility issues with paddlepaddle
  version 2.6.1 on certain Linux systems.

This change aims to make the FAQ more informative and easier to navigate for users
experiencing similar issues, providing direct solutions and links where applicable.
2024-08-06 16:08:48 +08:00
myhloli b0bd91dc43 docs: add conda install steps for environment setupAdd detailed steps on how to create a conda environment and activate it beforeproceeding with the pip installation of magic-pdf and required dependencies.
This provides users with a clearer guide on setting up their environment.
2024-08-06 16:02:28 +08:00
myhloli 5fcfd8b4af Update version.py with new version 2024-08-06 03:40:23 +00:00
myhloli 29e48c7398 mirror(conda): use tuna mirror for Anaconda download
Update the download links for Anaconda in both Ubuntu and Windows CUDA
Acceleration documents to use the Tuna mirror. This change helps ensure that
users in China have faster access to the Anaconda distribution.
magic_pdf-0.7.0a1-released
2024-08-05 19:12:20 +08:00
Xiaomeng Zhao 8c5ecdf159 Merge pull request #329 from papayalove/master
[fix bug] table recognition bug fixed#321
2024-08-05 17:03:32 +08:00
liukaiwen cae215bb5e fix table recognition bug#321 2024-08-05 17:01:12 +08:00
liukaiwen ec7271faee fix table recognition bug#321 2024-08-05 16:54:35 +08:00
liukaiwen b8adb630ee Merge branch 'master' of github.com:papayalove/Magic-PDF
# Conflicts:
#	docs/how_to_download_models_zh_cn.md
2024-08-05 16:53:09 +08:00
myhloli 520696126a refactor(common): Moving the output path logs from the start of the program to its end. 2024-08-04 23:57:58 +08:00
myhloli 52156eaee9 fix(pdf-extract): ensure table recognition config defaults to disabled
If 'table-config' is not present in the configuration file, the table recognition
feature will default to being disabled to ensure consistent behavior. This change
adds a warning log and sets a default configuration for table recognition when the
expected config is missing.
2024-08-04 23:50:25 +08:00
myhloli 0998d22a32 fix(ocr_mkcontent): add spaces around inline equation in content
Ensure proper formatting of inline equations by adding spaces outside the equation delimitersto prevent markdown from interpreting the equation content as part of a link. This addresses
the issue where inline OCR equations appear without the correct markdown formatting.
2024-08-04 23:44:49 +08:00
myhloli 252139099b fix(setup): allow latest matplotlib versions on non-Windows platforms
The restriction on the matplotlib version has been updated to only apply on Windows
platforms, where precompiled packages are not available starting from version 3.9.1.
This change enables users on Linux and macOS to install newer versions of matplotlib,
addressing compatibility issues with recent bug fixes.
2024-08-04 20:29:39 +08:00
myhloli 9ececf3a1e fix(dependencies): remove unnecessary pypandoc and struct-eqtable packages;fix matplotlib>=3.9.1 not support Windows system without compilation environment. 2024-08-04 20:23:21 +08:00
myhloli 9778a46142 docs: specify absolute path for model weights configuration
Update the README documents to clarify that the "models-dir" in the
configuration should be an absolute path. Also, provide additional guidance
for Windows users on how to correctly format the path to avoid common issues
with path escaping in JSON files.
2024-08-03 02:28:50 +08:00
myhloli 44a2dc3750 docs: add wget command for Ubuntu and powershell script for Windows
Add instructions to download the magic-pdf.template.json file using wget on
Ubuntu and a PowerShell script on Windows in the respective README files.
This is to facilitate the setup process by providing direct download options,
replacing manual file transfers.
2024-08-03 02:20:29 +08:00
sfk f6d399f2f4 Update README_zh-CN_v2.md
add demo url
2024-08-02 21:43:47 +08:00
myhloli 99d284a7e8 docs(README_zh-CN_v2): add note on GPU acceleration for CUDA supported devices
Add a note in the README_zh-CN_v2.md to clarify the availability of GPU
acceleration for devices supporting CUDA, directing users to specific
tutorials based on their operating system.
2024-08-02 16:54:13 +08:00
myhloli a0c62b2632 fix(docs): pin Magic-PDF version to 0.6.2b1 in install commands
Update the install commands in both Ubuntu and Windows CUDA Acceleration
guides to specify Magic-PDF version 0.6.2b1, ensuring consistency andavoiding potential version mismatches.
2024-08-02 16:50:29 +08:00
myhloli 961330f784 docs(FAQ): update dependency installation troubleshooting
Update the FAQ to clarify the dependency installation issue when using magic-pdf. Ensure
users are directed to install the specific version of magic-pdf that resolves the dependency
error, rather than listing all individual dependencies. This simplifies the troubleshooting process
and provides a direct solution for users encountering the "Required dependency not installed"
error.
2024-08-02 16:30:58 +08:00
myhloli a24890b18c docs(models_zh_cn): update download methods from ModelScope
Update the download methods for models in the Chinese documentation to reflect
the latest options available from ModelScope. Simplify the section titles and
revise download instructions for clarity and consistency.
2024-08-02 15:46:11 +08:00
myhloli a53cb30f69 Merge remote-tracking branch 'origin/master' 2024-08-02 15:42:04 +08:00
myhloli 3ef4d054cf docs: update model download instructions and CUDA acceleration setup
Update the documentation to reflect the latest model download procedures, emphasis on
model file integrity checks, and expanded instructions for setting up CUDA accelerationon Ubuntu and Windows environments. The README files for various OS have been
enhanced with additional details to assist users in configuring and verifying their
environments for optimal performance.
2024-08-02 15:41:54 +08:00
xuchao 8d88330d91 delete old magic-pdf cli 2024-08-02 15:01:56 +08:00
xuchao 2a06e0c8c0 Make the documentation on how to download the model more concise 2024-08-02 14:58:15 +08:00
xuchao f052c75e29 fix some misdescription in document 2024-08-02 14:58:15 +08:00
myhloli 1c5b42e0ae docs(zh-CN): update installation guide for magic-pdf
Update the Chinese documentation to include detailed steps for installingmagic-pdf using CPU and GPU. These updates clarify the process for end
users, addressing common issues such as configuration file placement and
model weight file downloads. The documentation now provides users with
direct links and version validation steps to ensure a smoother installation
experience.
2024-08-02 14:56:52 +08:00
Kaiwen Liuandliukaiwen 37925f36d9 feat(model inference): add table recognition and conversion to LaTeX (#284)
* # add table recognition using struct-eqtable
## Changelog
31/07/20204
- Support table recognition. Table images will be converted into html.

### how to use the new feature:
set the attribute 'table-mode' to 'true' in magic-pdf.json

### caution:
it takes 200s to 500s to convert a single table image using cpu

* # add table recognition using struct-eqtable
## Changelog
31/07/20204
- Support table recognition. Table images will be converted into LaTex.

### how to use the new feature:
set the attribute 'table-mode' to 'true' in magic-pdf.json

### caution:
it takes 200s to 500s to convert a single table image using cpu

* # feat(model inference): add table recognition and convertion to LaTeX

# What's Changed

### New Features

- Add table content recognition, we use weights of [StructEqTable](https://github.com/UniModal4Reasoning/StructEqTable-Deploy) to convert table image to LaTex.

### Instruction

- pip install pypandoc struct-eqtable==0.1.0
- Download [StructEqTable weights](https://huggingface.co/wanderkid/PDF-Extract-Kit/tree/main/models/TabRec) and put it under models/ directory.
- Edit 'table-mode' value to turn on table recognition function which is turned off by default.
- If you did not download any models before, refer to [how to download models](docs/how_to_download_models_zh_cn.md)。

* add table recognition and convertion to LaTeX

* add table recognition and conversion to LaTeX

* add table recognition and conversion to LaTeX

* add table recognition and conversion to LaTeX

---------

Co-authored-by: liukaiwen <liukaiwen@pjlab.org.cn>
2024-08-02 11:13:46 +08:00
myhloli 41737adf8c docs(output-file): correct poly coordinate format and update table descriptions
- Fix the description of the 'poly' coordinate format in the output file documentation to correctly reflect the order of coordinates: left-top, right-top, right-bottom,
  left-bottom.
- Update various table-related descriptions for clarity and consistency, including
  field names and their corresponding explanations.
- Add version name field description in 'middle.json' structure to document the
  version of the magic-pdf used in the parsing process.
- Refactor the block and line description tables to improve readability and alignment
  with the rest of the documentation.
2024-08-02 10:14:39 +08:00
icecraftandshenguanlin e155d32212 feat: remove dummpy code, magic_pdf/cli, magic_pdf/train_utils (#291)
* feat: remove dummpy code, magic_pdf/cli, magic_pdf/train_utils

* feat: expose version in command line

---------

Co-authored-by: shenguanlin <shenguanlin@pjlab.org.cn>
2024-08-01 19:59:43 +08:00
myhloli 15125623d1 docs: update README for Ubuntu CUDA Acceleration
- Adjust command installation format for PaddlePaddle GPU.
- Clarify instruction numbering for testing OCR acceleration.
2024-08-01 19:48:50 +08:00
myhloli a09291adbb docs(zh_CN): update Ubuntu CUDA setup guide for accuracy
Update the Ubuntu CUDA Acceleration setup guide to reflect the correct user directory
path and improve the clarity of instructions. Remove references to Windows and macOS
as they are out of scope for this document. Ensure the configuration file copying
command is correctly represented for Linux users.
2024-08-01 19:48:10 +08:00
myhloli 51a0bf4a42 fix(docs): correct link to magic-pdf.template.json in README
Update the link to the magic-pdf.template.json configuration template file in the
README_Ubuntu_CUDA_Acceleration_zh_CN.md document. The file path was previously
incorrect and has been amended to point to the correct location.
2024-08-01 19:46:07 +08:00
myhloli 866e47a0b2 docs(magic-pdf): update model directory reference in configuration
Update the instruction in README_Ubuntu_CUDA_Acceleration_zh_CN.md to reference
the correct section number for downloading the model weights. This change ensures
that users are directed to the correct location in the document for setting up the
model directory in the magic-pdf.json configuration.
2024-08-01 19:45:30 +08:00
myhloli 92b981bd22 Merge remote-tracking branch 'origin/master' 2024-08-01 19:43:23 +08:00
myhloli fc18a5cfd2 docs: update Ubuntu CUDA acceleration guide for version 0.6.2- Add steps for Ubuntu 22.04 LTS installation.
- Detail the process of checking, installing, and configuring NVIDIA drivers.
- Include instructions for installing Anaconda and creating a specific environment.
- Provide guidance on installing magic-pdf and its dependencies.
- Add a note to verify magic-pdf version and report issues if necessary.
- Describe the process of downloading models and configuring the application.
- Include a sample command to run the application with CUDA acceleration.
- Add a note for enabling OCR CUDA acceleration with specific GPU requirements.

This update ensures users have the latest information for setting up CUDA accelerationwith magic-pdf on Ubuntu 22.04 LTS, specifically for version 0.6.2, and provides clearer
instructions on the installation and configuration process.
2024-08-01 19:43:14 +08:00
xuchao a5e13b9744 modify command usage document 2024-08-01 19:32:59 +08:00
xuchao 1d2f55a371 modify readme_zh-cn_v2.md 2024-08-01 19:32:59 +08:00
myhloli 7bca348d57 upload ocr_demo pdf 2024-08-01 19:32:30 +08:00
myhloli a697002cfb Merge remote-tracking branch 'origin/master' 2024-08-01 19:28:07 +08:00
myhloli b4b2a09928 docs: restructure download guide and add ModelScope options
Restructured the how-to download models document for better clarity and
added sections on downloading models from ModelScope, including SDK and
Git download methods. Provided detailed steps for installing Git LFS and
checking model integrity after download. Also included recommendations
for moving the models to an SSD for better performance.
2024-08-01 19:27:57 +08:00
icecraftandshenguanlin 40e0827e60 Feat/impl cli (#264)
* feat: refractor cli command

* feat: add docs to describe the output files of cli

* feat: resove review comments

* feat: updat docs about middle.json

---------

Co-authored-by: shenguanlin <shenguanlin@pjlab.org.cn>
2024-08-01 19:21:15 +08:00
xuchao 5e38c4c873 add minerU video 2024-08-01 19:09:44 +08:00
liukaiwen 6de68f06b8 Merge branch 'master' of github.com:papayalove/Magic-PDF 2024-08-01 18:48:28 +08:00
drunkpig 374913044a Merge pull request #286 from nutshellfool/patch-1
Update how_to_download_models_en.md
2024-08-01 18:46:25 +08:00
Kaiwen Liu 2523ba6690 Merge branch 'opendatalab:master' into master 2024-08-01 18:46:13 +08:00
liukaiwen b9667fd3e3 add table recognition and conversion to LaTeX 2024-08-01 18:45:56 +08:00
myhloli 3abf22cc77 docs(readme): update wheel install URL 2024-08-01 18:20:08 +08:00