DBNet
Real-time Scene Text Detection with Differentiable Binarization
Abstract
Recently, segmentation-based methods are quite popular in scene text detection, as the segmentation results can more accurately describe scene text of various shapes such as curve text. However, the post-processing of binarization is essential for segmentation-based detection, which converts probability maps produced by a segmentation method into bounding boxes/regions of text. In this paper, we propose a module named Differentiable Binarization (DB), which can perform the binarization process in a segmentation network. Optimized along with a DB module, a segmentation network can adaptively set the thresholds for binarization, which not only simplifies the post-processing but also enhances the performance of text detection. Based on a simple segmentation network, we validate the performance improvements of DB on five benchmark datasets, which consistently achieves state-of-the-art results, in terms of both detection accuracy and speed. In particular, with a light-weight backbone, the performance improvements by DB are significant so that we can look for an ideal tradeoff between detection accuracy and efficiency. Specifically, with a backbone of ResNet-18, our detector achieves an F-measure of 82.8, running at 62 FPS, on the MSRA-TD500 dataset.
Results and models
ICDAR2015
| Method |
Backbone |
Pretrained Model |
Training set |
Test set |
#epochs |
Test size |
Precision |
Recall |
Hmean |
Download |
| DBNet_r18 |
ResNet18 |
- |
ICDAR2015 Train |
ICDAR2015 Test |
1200 |
736 |
0.8853 |
0.7583 |
0.8169 |
model | log |
| DBNet_r50 |
ResNet50 |
- |
ICDAR2015 Train |
ICDAR2015 Test |
1200 |
1024 |
0.8744 |
0.8276 |
0.8504 |
model | log |
| DBNet_r50dcn |
ResNet50-DCN |
Synthtext |
ICDAR2015 Train |
ICDAR2015 Test |
1200 |
1024 |
0.8784 |
0.8315 |
0.8543 |
model | log |
| DBNet_r50-oclip |
ResNet50-oCLIP |
- |
ICDAR2015 Train |
ICDAR2015 Test |
1200 |
1024 |
0.9052 |
0.8272 |
0.8644 |
model | log |
Total Text
| Method |
Backbone |
Pretrained Model |
Training set |
Test set |
#epochs |
Test size |
Precision |
Recall |
Hmean |
Download |
| DBNet_r18 |
ResNet18 |
- |
Totaltext Train |
Totaltext Test |
1200 |
736 |
0.8640 |
0.7770 |
0.8182 |
model | log |
Citation
@article{Liao_Wan_Yao_Chen_Bai_2020,
title={Real-Time Scene Text Detection with Differentiable Binarization},
journal={Proceedings of the AAAI Conference on Artificial Intelligence},
author={Liao, Minghui and Wan, Zhaoyi and Yao, Cong and Chen, Kai and Bai, Xiang},
year={2020},
pages={11474-11481}}
39f99ac720