UVDoc

ProviderPaddlePaddle
Categoryimage-to-text
Licenseapache-2.0
Downloads408.2K
Stars1

Overview

UVDoc is a specialized image-to-text model developed by PaddlePaddle, designed to handle complex document parsing and visual information extraction. Unlike general-purpose OCR, UVDoc focuses on maintaining the structural integrity of documents, making it highly effective for digitizing forms, reports, and structured layouts where spatial positioning is critical. For developers, this means a streamlined pipeline for converting visual documents into machine-readable text without losing the context of the original formatting. Licensed under Apache-2.0, it offers the flexibility for commercial integration into enterprise document management systems or automated data entry workflows. It serves as a robust alternative for those needing high-precision document understanding within the PaddlePaddle ecosystem.

Highlights

  • High-precision extraction of structured document layouts
  • Apache-2.0 license for flexible commercial deployment
  • Optimized for PaddlePaddle ecosystem integration
  • Efficient conversion of complex images to text

Usage

Install
# Install Hugging Face transformers
pip install transformers torch
SDK Usage
# Load model with transformers
from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("PaddlePaddle/UVDoc")
tokenizer = AutoTokenizer.from_pretrained("PaddlePaddle/UVDoc")

Hugging Face Download

We recommend downloading the model via the Hugging Face CLI or Hub SDK.

Guidance:Before downloading, install huggingface_hub with:

Guidance
pip install -U huggingface_hub

CLI Download

Download the full repository

Download the full repository
huggingface-cli download PaddlePaddle/UVDoc

Download a single file to a local folder (e.g. config.json into ./dir)

Download a single file to a local folder (e.g. config.json into ./dir)
huggingface-cli download PaddlePaddle/UVDoc config.json --local-dir ./dir

See the official docs for more CLI options

SDK Download

SDK Download
# 模型下载
from huggingface_hub import snapshot_download
model_dir = snapshot_download('PaddlePaddle/UVDoc')

Git Download

Make sure git-lfs is installed first

Git Download
git lfs install
git clone https://huggingface.co/PaddlePaddle/UVDoc

To skip LFS large-file downloads, use:

Skip LFS
GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/PaddlePaddle/UVDoc

Model files are hosted on the Hugging Face Hub — download directly via HF CLI / SDK / Git, not through this site.

PyTorch / Transformers Usage

Install Transformers

Install Transformers
pip install -U transformers torch

Load the model and run inference

Load the model and run inference
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained('PaddlePaddle/UVDoc')
tokenizer = AutoTokenizer.from_pretrained('PaddlePaddle/UVDoc')

Model Download

We recommend downloading the model via the ModelScope CLI or SDK.

Guidance:Before downloading, install ModelScope with:

Guidance
pip install modelscope

CLI Download

Download the full repository

Download the full repository
modelscope download --model PaddlePaddle/UVDoc

Download a single file to a local folder (e.g. README.md into ./dir)

Download a single file to a local folder (e.g. README.md into ./dir)
modelscope download --model PaddlePaddle/UVDoc README.md --local_dir ./dir

See the docs for more CLI options

SDK Download

SDK Download
# 模型下载
from modelscope import snapshot_download
model_dir = snapshot_download('PaddlePaddle/UVDoc')

Git Download

Make sure git-lfs is installed first

Git Download
git lfs install
git clone https://www.modelscope.cn/PaddlePaddle/UVDoc.git

To skip LFS large-file downloads, use:

Skip LFS
GIT_LFS_SKIP_SMUDGE=1 git clone https://www.modelscope.cn/PaddlePaddle/UVDoc.git

ModelScope 模型页直接下载模型文件;无需将模型文件放在本站服务器。

Notebook Quickstart

Install the ModelScope library

Install the ModelScope library
pip install "modelscope[audio,cv,nlp,multi-modal,science]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html

Load the model and run inference

Load the model and run inference
from modelscope.pipelines import pipeline
from modelscope.utils.constant import Tasks

p = pipeline('text-generation', 'PaddlePaddle/UVDoc')

Full Documentation

来源: HuggingFace

---
license: apache-2.0
library_name: PaddleOCR
language:

  • en

  • zh

pipeline_tag: image-to-text
tags:
  • OCR

  • PaddlePaddle

  • PaddleOCR

  • doc_img_unwarping

---

UVDoc

Introduction

The main purpose of text image correction is to carry out geometric transformation on the image to correct the document distortion, inclination, perspective deformation and other problems in the image, so that the subsequent text recognition can be more accurate.

| Model| CER |
| --- | --- |
|UVDoc | 0.179 |

Note: Test data set: docunet benchmark data set.

Quick Start

Installation

1. PaddlePaddle

Please refer to the following commands to install PaddlePaddle using pip:

bash
# for CUDA11.8
python -m pip install paddlepaddle-gpu==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu118/

for CUDA12.6

python -m pip install paddlepaddle-gpu==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu126/

for CPU

python -m pip install paddlepaddle==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cpu/

For details about PaddlePaddle installation, please refer to the PaddlePaddle official website.

2. PaddleOCR

Install the latest version of the PaddleOCR inference package from PyPI:

bash
python -m pip install paddleocr

Model Usage

You can quickly experience the functionality with a single command:

bash
paddleocr text_image_unwarping --model_name UVDoc -i https://cdn-uploads.huggingface.co/production/uploads/63d7b8ee07cd1aa3c49a2026/SfMVKd0xnMII5KBDV6Mfz.jpeg

You can also integrate the model inference of the TextImageUnwarping module into your project. Before running the following code, please download the sample image to your local machine.

python
from paddleocr import TextImageUnwarping

model = TextImageUnwarping(model_name="UVDoc")
output = model.predict("SfMVKd0xnMII5KBDV6Mfz.jpeg", batch_size=1)
for res in output:
res.print()
res.save_to_img(save_path="./output/")
res.save_to_json(save_path="./output/res.json")

After running, the obtained result is as follows:

json
{'res': {'input_path': 'doc_test.jpg', 'page_index': None, 'doctr_img': '...'}}

The visualized image is as follows:

!image/jpeg

For details about usage command and descriptions of parameters, please refer to the Document.

Pipeline Usage

The ability of a single model is limited. But the pipeline consists of several models can provide more capacity to resolve difficult problems in real-world scenarios.

#### PP-StructureV3

Layout analysis is a technique used to extract structured information from document images. PP-StructureV3 includes the following six modules:

  • Layout Detection Module

  • General OCR Sub-pipeline

  • Document Image Preprocessing Sub-pipeline (Optional)

  • Table Recognition Sub-pipeline (Optional)

  • Seal Recognition Sub-pipeline (Optional)

  • Formula Recognition Sub-pipeline (Optional)

You can quickly experience the PP-StructureV3 pipeline with a single command.

bash
paddleocr pp_structurev3 --use_doc_unwarping True -i https://cdn-uploads.huggingface.co/production/uploads/63d7b8ee07cd1aa3c49a2026/KP10tiSZfAjMuwZUSLtRp.png

You can experience the inference of the pipeline with just a few lines of code. Taking the PP-StructureV3 pipeline as an example:

python
from paddleocr import PPStructureV3

pipeline = PPStructureV3(use_doc_unwarping=True) # Use use_doc_unwarping to enable/disable document unwarping module
output = pipeline.predict("./KP10tiSZfAjMuwZUSLtRp.png")
for res in output:
res.print() ## Print the structured prediction output
res.save_to_json(save_path="output") ## Save the current image's structured result in JSON format
res.save_to_markdown(save_path="output") ## Save the current image's result in Markdown format

For details about usage command and descriptions of parameters, please refer to the Document.

Links

PaddleOCR Repo

PaddleOCR Documentation

Join our Telegram