Commit Graph

218 Commits (5cf3ac5c2de18b4c20238a4943d0f49d835999e3)

Author SHA1 Message Date
zhangyubo0722 362103bd0b
fix lateocr bug (#13920) 2024-09-28 19:11:31 +08:00
zhangyubo0722 2b51369324
support export after save model (#13844) 2024-09-25 01:11:01 +08:00
johnlockejrr ada310811a
Add Syriac script support (#13800)
* Add Syriac Language support dictionary

The Syriac Script is a Unicode block containing characters for all forms of the Syriac alphabet, including the Estrangela, Serto, Eastern Syriac, and the Christian Palestinian Aramaic variants. It is used in Literary Syriac, Neo-Aramaic, and Arabic among Syriac-speaking Christians. It was used historically to write Armenian, Persian, Ottoman Turkish, and Malayalam. The script, like Arabic and Hebrew is RTL.

https://en.wikipedia.org/wiki/Syriac_(Unicode_block)
https://en.wikipedia.org/wiki/Syriac_language

* Add Syriac script support for training

The Syriac Script is a Unicode block containing characters for all forms of the Syriac alphabet, including the Estrangela, Serto, Eastern Syriac, and the Christian Palestinian Aramaic variants. It is used in Literary Syriac, Neo-Aramaic, and Arabic among Syriac-speaking Christians. It was used historically to write Armenian, Persian, Ottoman Turkish, and Malayalam. The script, like Arabic and Hebrew is RTL.

https://en.wikipedia.org/wiki/Syriac_(Unicode_block)
https://en.wikipedia.org/wiki/Syriac_language
2024-09-01 20:10:42 +08:00
johnlockejrr 6225a90ef0
Add support for Hebrew Language and Alphabet (#13797)
* Add Hebrew language support for training

https://en.wikipedia.org/wiki/Unicode_and_HTML_for_the_Hebrew_alphabet

* Add Hebrew language dictionary

https://en.wikipedia.org/wiki/Unicode_and_HTML_for_the_Hebrew_alphabet

* Add Samaritan Script dictionary

Samaritan Script is RTL like Arabic and Hebrew, used for Samaritan Hebrew and Aramaic, sometimes has Arabic letters in some texts.

https://en.wikipedia.org/wiki/Samaritan_(Unicode_block)
https://en.wikipedia.org/wiki/Samaritan_Hebrew
https://en.wikipedia.org/wiki/Samaritan_Aramaic_language

* Add Samaritan Script training

Samaritan Script is RTL like Arabic and Hebrew, used for Samaritan Hebrew and Aramaic, sometimes has Arabic letters in some texts.

https://en.wikipedia.org/wiki/Samaritan_(Unicode_block)
https://en.wikipedia.org/wiki/Samaritan_Hebrew
https://en.wikipedia.org/wiki/Samaritan_Aramaic_language

* Update hebrew_dict.txt
2024-09-01 09:18:37 +08:00
liuhongen1234567 1752c56cb7
修改LaTeXOCR的数据处理部分,将生成的数据集中的绝对路径改为相对路径 (#13702)
* test

* dataprocess_abspath2relpath
2024-08-20 15:45:57 +08:00
Songling Huang 01e60ff9e1
add vietnamese char dict (#13698) 2024-08-19 22:35:40 +08:00
Songling Huang e22ce35c94
Add files via upload (#13685)
Burmese dictionary expansion
2024-08-18 21:54:43 +08:00
liuhongen1234567 5f0b90a110
Fix some issues with LaTeXOCR in paddleX (#13646)
* repair_some_Bug_for_paddlex

* style2

* style2

* add_epilson_for groupnorm
2024-08-14 11:30:25 +08:00
changdazhou 20de659502
fix download bug when use multi gpus (#13610) 2024-08-06 21:15:52 +08:00
changdazhou b6211b936b
support benchmark for paddlepaddle3.0 (#13574) 2024-08-02 19:24:40 +08:00
zhangyubo0722 6c12df47b2
merge release/2.6.1 to main (#13523) 2024-07-29 19:09:42 +08:00
Wang Xin 428832f6ee
remove some of the less common dependencies (#13461)
* remove some of the less common dependencies

* remove dependencies
2024-07-24 19:29:58 +08:00
liuhongen1234567 cf26f2330e
Latexocr paddle (#13401)
* commit_test

* modified:   configs/rec/rec_latex_ocr.yml
	deleted:    ppocr/modeling/backbones/rec_resnetv2.py

* ntuple_solve

* style

* style

* style

* style

* style

* style

* style

* style

* style

* delete comment

* cla_email
2024-07-22 11:50:23 +08:00
Taeef Najib 820c240593
add bn_dict.txt (#13373)
* add bn_dict.txt

* add new line at the end of file
2024-07-13 08:30:45 +08:00
jzhang533 24f06d1a1b
update common pre-commit configs and commit the results of running pre-commit run -a (#12516) 2024-05-29 15:26:09 +08:00
jzhang533 a2ad2124c7
commit fix by running pre-commit run -a (#12165) 2024-05-24 12:12:42 +08:00
Wang Xin af87691591
add ci for paddleocr test (#12062)
* add ci for paddleocr test

* fix flake8 error

* fix paddlepaddle deps

* add dep

* fix

* move flake8 to pre-commit

* update ut

* fix bug

* fix bug set paddlepaddle==2.5

* fix bug

* fix bug

* fix bug

* update test

* remove lscpu
2024-05-22 13:02:24 +08:00
Muhammad Asif 579d0c34d4
Added Bengali , gujrati and kazakh dictionary (#12151) 2024-05-22 10:12:38 +08:00
Wang Xin f5defabb60
fix the issue of repeatedly downloading pretrained model (#12142)
* fix the issue of repeatedly downloading pretrained model

* add log info
2024-05-20 19:22:45 +08:00
Ichimaru Gin 95e3103f88
Burmese Language dict and corpus (#12020)
* updated bm_dict

* ppocr/utils/dict/README.md added

* minor fix

---------

Co-authored-by: Zhang Jun <jzhang533@gmail.com>
2024-04-30 15:15:14 +08:00
张春乔 a730065e7b
【OCR Issue No.9】以可选形式支持Visualdl (#11947)
* delete visual dl

* totally delete visual

* delete vdl file

* fix codestyle
2024-04-25 17:37:27 +08:00
Wang Xin 045e5f6ac7
add pre-commit workflow (#11973)
* add pre-commit workflow

* run 'pre-commit run --all-files'

* setup python version
2024-04-21 21:46:20 +08:00
NeterOster fa93f61cc5
fix: Correct misuse of `try_import` from `paddle.utils` (#11820)
This commit addresses the incorrect usage of the `try_import` function from `paddle.utils` in both `ppocr/utils/utility.py` and `ppstructure/pdf2word/pdf2word.py`.
2024-03-28 11:26:36 +08:00
xiaoting b583b4773f
cherry-pick for lazy import pymupdf and pre-commit (#11692)
Co-authored-by: jzhang533 <jzhang533@gmail.com>
2024-03-13 12:34:31 +08:00
fzhi bf6b100f85
update uygur dict (#11125) 2023-10-26 15:32:55 +08:00
shiyutang e3fc6393e0
[Cherry-pick] Cherry-pick from release/2.6 (#11092)
* Update recognition_en.md (#10059)

ic15_dict.txt only have 36 digits

* Update ocr_rec.h (#9469)

It is enough to include preprocess_op.h, we do not need to include ocr_cls.h.

* 补充num_classes注释说明 (#10073)

ser_vi_layoutxlm_xfund_zh.yml中的Architecture.Backbone.num_classes所赋值会设置给Loss.num_classes,
由于采用BIO标注,假设字典中包含n个字段(包含other)时,则类别数为2n-1;假设字典中包含n个字段(不含other)时,则类别数为2n+1。

* Update algorithm_overview_en.md (#9747)

Fix links to super-resolution algorithm docs

* 改进文档`deploy/hubserving/readme.md`和`doc/doc_ch/models_list.md` (#9110)

* Update readme.md

* Update readme.md

* Update readme.md

* Update models_list.md

* trim trailling spaces @ `deploy/hubserving/readme_en.md`

* `s/shell/bash/` @ `deploy/hubserving/readme_en.md`

* Update `deploy/hubserving/readme_en.md` to sync with `deploy/hubserving/readme.md`

* Update deploy/hubserving/readme_en.md to sync with `deploy/hubserving/readme.md`

* Update deploy/hubserving/readme_en.md to sync with `deploy/hubserving/readme.md`

* Update `doc/doc_en/models_list_en.md` to sync with `doc/doc_ch/models_list_en.md`

* using Grammarly to weak `deploy/hubserving/readme_en.md`

* using Grammarly to tweak `doc/doc_en/models_list_en.md`

* `ocr_system` module will return with values of field `confidence`

* Update README_CN.md

* 修复测试服务中图片转Base64的引用地址错误。 (#8334)

* Update application.md

* [Doc] Fix 404 link.  (#10318)

* Update PP-OCRv3_det_train.md

* Update knowledge_distillation.md

* Update config.md

* Fix fitz camelCase deprecation and .PDF not being recognized as pdf file (#10181)

* Fix fitz camelCase deprecation and .PDF not being recognized as pdf file

* refactor get_image_file_list function

* Update customize.md (#10325)

* Update FAQ.md (#10345)

* Update FAQ.md (#10349)

* Don't break overall processing on a bad image (#10216)

* Add preprocessing common to OCR tasks (#10217)

Add preprocessing to options

* [MLU] add mlu device for infer (#10249)

* Create newfeature.md

* Update newfeature.md

* remove unused imported module, so can avoid PyInstaller packaged binary's start-time not found module error. (#10502)

* CV套件建设专项活动 - 文字识别返回单字识别坐标 (#10515)

* modification of return word box

* update_implements

* Update rec_postprocess.py

* Update utility.py

* Update README_ch.md

* revert README_ch.md update

* Fixed Layout recovery README file (#10493)

Co-authored-by: Shubham Chambhare <shubhamchambhare@zoop.one>

* update_doc

* bugfix

---------

Co-authored-by: ChuongLoc <89434232+ChuongLoc@users.noreply.github.com>
Co-authored-by: Wang Xin <xinwang614@gmail.com>
Co-authored-by: tanjh <dtdhinjapan@gmail.com>
Co-authored-by: Louis Maddox <lmmx@users.noreply.github.com>
Co-authored-by: n0099 <n@n0099.net>
Co-authored-by: zhenliang li <37922155+shouyong@users.noreply.github.com>
Co-authored-by: itasli <ilyas.tasli@outlook.fr>
Co-authored-by: UserUnknownFactor <63057995+UserUnknownFactor@users.noreply.github.com>
Co-authored-by: PeiyuLau <135964669+PeiyuLau@users.noreply.github.com>
Co-authored-by: kerneltravel <kjpioo2006@gmail.com>
Co-authored-by: ToddBear <43341135+ToddBear@users.noreply.github.com>
Co-authored-by: Ligoml <39876205+Ligoml@users.noreply.github.com>
Co-authored-by: Shubham Chambhare <59397280+Shubham654@users.noreply.github.com>
Co-authored-by: Shubham Chambhare <shubhamchambhare@zoop.one>
Co-authored-by: andyj <87074272+andyjpaddle@users.noreply.github.com>
2023-10-18 17:37:23 +08:00
zhangyubo0722 e49e491417
add svtr large model (#10937)
* add svtr large model

* [WIP]add svtr large model
2023-09-26 14:38:29 +08:00
ToddBear 75d16610f4
Add new recognition method "ParseQ" (#10836)
* Update PP-OCRv4_introduction.md

* Update PP-OCRv4_introduction.md (#10616)

* Update PP-OCRv4_introduction.md

* Update PP-OCRv4_introduction.md

* Update PP-OCRv4_introduction.md

* Update README.md

* Cherrypicking GH-10217 and GH-10216 to PaddlePaddle:Release/2.7 (#10655)

* Don't break overall processing on a bad image

* Add preprocessing common to OCR tasks
Add preprocessing to options

* Update requirements.txt (#10656)

added missing pyyaml library

* [TIPC]update xpu tipc script (#10658)

* fix-typo (#10642)

Co-authored-by: Dennis <dvorst@users.noreply.github.com>
Co-authored-by: shiyutang <34859558+shiyutang@users.noreply.github.com>

* 修改数据增强导致的DSR报错 (#10662) (#10681)

* 修改数据增强导致的DSR报错

* 错误修改回滚

* Update algorithm_overview_en.md (#10670)

Fixed simple spelling errors.

* Implement recoginition method ParseQ

* Document update for new recognition method ParseQ

* add prediction for parseq

* Update rec_vit_parseq.yml

* Update rec_r31_sar.yml

* Update rec_r31_sar.yml

* Update rec_r50_fpn_srn.yml

* Update rec_vit_parseq.py

* Update rec_vit_parseq.yml

* Update rec_parseq_head.py

* Update rec_img_aug.py

* Update rec_vit_parseq.yml

* Update __init__.py

* Update predict_rec.py

* Update paddleocr.py

* Update requirements.txt

* Update utility.py

* Update utility.py

---------

Co-authored-by: xiaoting <31891223+tink2123@users.noreply.github.com>
Co-authored-by: topduke <784990967@qq.com>
Co-authored-by: dyning <dyning.2003@163.com>
Co-authored-by: UserUnknownFactor <63057995+UserUnknownFactor@users.noreply.github.com>
Co-authored-by: itasli <ilyas.tasli@outlook.fr>
Co-authored-by: Kai Song <50285351+USTCKAY@users.noreply.github.com>
Co-authored-by: dvorst <87502756+dvorst@users.noreply.github.com>
Co-authored-by: Dennis <dvorst@users.noreply.github.com>
Co-authored-by: shiyutang <34859558+shiyutang@users.noreply.github.com>
Co-authored-by: Dec20B <1192152456@qq.com>
Co-authored-by: ncoffman <51147417+ncoffman@users.noreply.github.com>
2023-09-07 16:36:47 +08:00
itasli 66461c3325
Cherrypicking GH-10251 & GH-10181 to PaddleOCR:dygraph (#10710)
* fix undefined save_model_dir when using wandb (#10251)

* fix undefined save_model_dir when using wand

* Update program.py

* Fix fitz camelCase deprecation and .PDF not being recognized as pdf file (#10181)

* Fix fitz camelCase deprecation and .PDF not being recognized as pdf file

* refactor get_image_file_list function
2023-08-30 10:21:29 +08:00
UserUnknownFactor b3912fcf7a
Cherrypicking GH-10217 and GH-10216 to PaddlePaddle:dygraph (#10654)
* Don't break overall processing on a bad image

* Add preprocessing common to OCR tasks
Add preprocessing to options
2023-08-21 16:33:03 +08:00
shiyutang 4a91a21245
compat_pillow (#10596) 2023-08-10 16:41:35 +08:00
livingbody 49d1a59572
upgrade pillow to 10.0.0 (#10405) 2023-07-17 14:42:30 +08:00
Lin Manhui 2d44a71b20
Toward Devkit Consistency (#10150)
* Accommodate UAPI

* Fix signal handler

* Save model.pdopt

* Change variable name

* Update vdl dir
2023-06-14 14:31:45 +08:00
gmm cdf6d1fb42
fix profile (#10121) 2023-06-08 18:54:29 +08:00
zhoujun 36ec3a406c
update tipc to_static (#9369)
* add d2s train for slanet and v3

* fix bug

* udpate tipc to_static

* update db

* remove_print

* update benchmark_train.sh

* update maybe_download_params
2023-03-10 19:07:37 +08:00
zhoujun 2e05d54af8
add d2s train for slanet and v3 (#9341)
* add d2s train for slanet and v3

* fix bug
2023-03-09 11:21:34 +08:00
zhoujun 623424fce0
support auto download model from bos (#9349) 2023-03-08 19:21:28 +08:00
Double_V 3629d5a365
support set gpu_id when inference (#8926)
* support min_area_rect crop

* add check_install

* fix requirement.txt

* fix check_install

* add lanms-neo for drrg

* fix

* fix doc

* fix

* support set gpu_id when inference

* fix #8855

* fix #8855
2023-01-30 18:46:41 +08:00
zhoujun f45c6ec668
mv Polygon import into func (#8506) 2022-12-01 16:02:47 +08:00
Double_V 58a5c0b35d
[check_install] (#8177)
* support min_area_rect crop

* add check_install

* fix requirement.txt

* fix check_install

* add lanms-neo for drrg

* fix

* fix doc
2022-11-15 14:25:39 +08:00
littletomatodonkey b92501faf6
fix pic (#8067) 2022-10-24 15:43:01 +08:00
Lizhi Chen 182c1db291
Merge branch 'dygraph' into dygraph 2022-10-20 10:14:55 +08:00
chenlizhi 0cdfc52507 add sr model Text Telescope 2022-10-17 15:15:37 +08:00
dorren f3f473d3f9 update CAN model 2022-10-15 20:27:05 +08:00
huangjun12 b5268dc3a0 add centripetal text model 2022-09-15 11:08:16 +00:00
Double_V d022b26903
Merge pull request #7420 from wangjingyeye/dyg_db
update pgnet
2022-09-05 18:45:44 +08:00
wangjingyeye 0fd122b674 update pgnet 2022-09-05 09:06:17 +00:00
wangjingyeye 4c0b08733d update pgnet 2022-09-05 07:03:16 +00:00
wangjingyeye 929b4f4557 update pgnet 2022-08-30 05:58:39 +00:00
MissPenguin e6c6250493
Merge pull request #7208 from Topdu/dygraph
update arabic rec model & add pred reverse function
2022-08-24 16:28:29 +08:00