PaddleOCR/doc/doc_en/algorithm_overview_en.md
2020-12-03 17:29:29 +08:00

3.7 KiB
Raw Blame History

Algorithm introduction

This tutorial lists the text detection algorithms and text recognition algorithms supported by PaddleOCR, as well as the models and metrics of each algorithm on English public datasets. It is mainly used for algorithm introduction and algorithm performance comparison. For more models on other datasets including Chinese, please refer to PP-OCR v1.1 models list.

1. Text Detection Algorithm

PaddleOCR open source text detection algorithms list:

On the ICDAR2015 dataset, the text detection result is as follows:

Model Backbone precision recall Hmean Download link
EAST ResNet50_vd Coming soon
EAST MobileNetV3 Coming soon
DB ResNet50_vd Coming soon
DB MobileNetV3 Coming soon
SAST ResNet50_vd Coming soon

On Total-Text dataset, the text detection result is as follows:

Model Backbone precision recall Hmean Download link
SAST ResNet50_vd Coming soon

Note Additional data, like icdar2013, icdar2017, COCO-Text, ArT, was added to the model training of SAST. Download English public dataset in organized format used by PaddleOCR from Baidu Drive (download code: 2bpi).

For the training guide and use of PaddleOCR text detection algorithms, please refer to the document Text detection model training/evaluation/prediction

2. Text Recognition Algorithm

PaddleOCR open-source text recognition algorithms list:

Refer to DTRB, the training and evaluation result of these above text recognition (using MJSynth and SynthText for training, evaluate on IIIT, SVT, IC03, IC13, IC15, SVTP, CUTE) is as follow:

Model Backbone Avg Accuracy Module combination Download link
Rosetta Resnet34_vd rec_r34_vd_none_none_ctc Coming soon
Rosetta MobileNetV3 rec_mv3_none_none_ctc Coming soon
CRNN Resnet34_vd rec_r34_vd_none_bilstm_ctc Coming soon
CRNN MobileNetV3 rec_mv3_none_bilstm_ctc Coming soon
STAR-Net Resnet34_vd rec_r34_vd_tps_bilstm_ctc Coming soon
STAR-Net MobileNetV3 rec_mv3_tps_bilstm_ctc Coming soon
RARE Resnet34_vd rec_r34_vd_tps_bilstm_attn Coming soon
RARE MobileNetV3 rec_mv3_tps_bilstm_attn Coming soon
SRN Resnet50_vd_fpn rec_r50fpn_vd_none_srn Coming soon

Note SRN model uses data expansion method to expand the two training sets mentioned above, and the expanded data can be downloaded from Baidu Drive (download code: y3ry).

The average accuracy of the two-stage training in the original paper is 89.74%, and that of one stage training in paddleocr is 88.33%. Both pre-trained weights can be downloaded here.

Please refer to the document for training guide and use of PaddleOCR text recognition algorithms Text recognition model training/evaluation/prediction