pdf转markdown
 
 
Go to file
zhangzhichao 13ec4a6e93 Merge pull request 'zzc' () from zzc into main
Reviewed-on: 
helper requirements.txt
models/PaddleDetection/inference_model 文本方向分类优化&更新版面分析模型
third_party 文本方向分类优化&更新版面分析模型
visual_images first commit
.env 文本方向分类优化&更新版面分析模型
.env.dev 文本方向分类优化&更新版面分析模型
.gitignore 表格识别和扫描件识别内部的ocr改为paddleocr
README.md first commit
download_MinerU_models.py first commit
fix_requirements.py requirements.txt
magic-pdf.json first commit
pipeline.py 文本方向分类优化&更新版面分析模型
requirements.txt requirements.txt
server.py 文本方向分类优化&更新版面分析模型

README.md

环境说明

# 1. pdf转图片需要安装以下依赖
apt install -y poppler-utils
# 2. 解决paddle的兼容问题
export FLAGS_enable_pir_api=0
# 3. 安装paddlepaddle-gpu后需要配置的环境
apt install libcudnn8
apt install libcudnn8-dev
echo "export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/lib/python3.11/site-packages/nvidia/cublas/lib/" >> /etc/profile
# 4. 手动安装MinerU需要用到的模型下载路径:
# model_dir is: /root/.cache/modelscope/hub/models/opendatalab/PDF-Extract-Kit-1___0/models
# layoutreader_model_dir is: /root/.cache/modelscope/hub/models/ppaanngggg/layoutreader
# The configuration file has been configured successfully, the path is: /root/magic-pdf.json
# 需要将项目中的magic-pdf.json链接到/root/magic-pdf.json
ln -s `pwd`/magic-pdf.json /root/magic-pdf.json
python download_MinerU_models.py
# 5. python连接postgresql需要下载的依赖
apt install postgresql postgresql-contrib libpq-dev