362103bd0b
fix lateocr bug ( #13920 )
2024-09-28 19:11:31 +08:00
2b51369324
support export after save model ( #13844 )
2024-09-25 01:11:01 +08:00
ac5313d0b1
fix bugs for SLANet infer ( #13861 )
2024-09-13 12:53:09 +08:00
4832bb62ad
Fix pir dy2st train ( #13853 )
2024-09-11 18:54:37 +08:00
ada310811a
Add Syriac script support ( #13800 )
...
* Add Syriac Language support dictionary
The Syriac Script is a Unicode block containing characters for all forms of the Syriac alphabet, including the Estrangela, Serto, Eastern Syriac, and the Christian Palestinian Aramaic variants. It is used in Literary Syriac, Neo-Aramaic, and Arabic among Syriac-speaking Christians. It was used historically to write Armenian, Persian, Ottoman Turkish, and Malayalam. The script, like Arabic and Hebrew is RTL.
https://en.wikipedia.org/wiki/Syriac_(Unicode_block)
https://en.wikipedia.org/wiki/Syriac_language
* Add Syriac script support for training
The Syriac Script is a Unicode block containing characters for all forms of the Syriac alphabet, including the Estrangela, Serto, Eastern Syriac, and the Christian Palestinian Aramaic variants. It is used in Literary Syriac, Neo-Aramaic, and Arabic among Syriac-speaking Christians. It was used historically to write Armenian, Persian, Ottoman Turkish, and Malayalam. The script, like Arabic and Hebrew is RTL.
https://en.wikipedia.org/wiki/Syriac_(Unicode_block)
https://en.wikipedia.org/wiki/Syriac_language
2024-09-01 20:10:42 +08:00
6225a90ef0
Add support for Hebrew Language and Alphabet ( #13797 )
...
* Add Hebrew language support for training
https://en.wikipedia.org/wiki/Unicode_and_HTML_for_the_Hebrew_alphabet
* Add Hebrew language dictionary
https://en.wikipedia.org/wiki/Unicode_and_HTML_for_the_Hebrew_alphabet
* Add Samaritan Script dictionary
Samaritan Script is RTL like Arabic and Hebrew, used for Samaritan Hebrew and Aramaic, sometimes has Arabic letters in some texts.
https://en.wikipedia.org/wiki/Samaritan_(Unicode_block)
https://en.wikipedia.org/wiki/Samaritan_Hebrew
https://en.wikipedia.org/wiki/Samaritan_Aramaic_language
* Add Samaritan Script training
Samaritan Script is RTL like Arabic and Hebrew, used for Samaritan Hebrew and Aramaic, sometimes has Arabic letters in some texts.
https://en.wikipedia.org/wiki/Samaritan_(Unicode_block)
https://en.wikipedia.org/wiki/Samaritan_Hebrew
https://en.wikipedia.org/wiki/Samaritan_Aramaic_language
* Update hebrew_dict.txt
2024-09-01 09:18:37 +08:00
aabff3958c
fix setting of make border epoch ( #13783 )
2024-08-29 22:27:28 +08:00
1752c56cb7
修改LaTeXOCR的数据处理部分，将生成的数据集中的绝对路径改为相对路径 ( #13702 )
...
* test
* dataprocess_abspath2relpath
2024-08-20 15:45:57 +08:00
01e60ff9e1
add vietnamese char dict ( #13698 )
2024-08-19 22:35:40 +08:00
e22ce35c94
Add files via upload ( #13685 )
...
Burmese dictionary expansion
2024-08-18 21:54:43 +08:00
5f0b90a110
Fix some issues with LaTeXOCR in paddleX ( #13646 )
...
* repair_some_Bug_for_paddlex
* style2
* style2
* add_epilson_for groupnorm
2024-08-14 11:30:25 +08:00
6dc021115c
disable automatic checks for new version albumentations ( #13583 )
2024-08-07 07:00:05 +08:00
20de659502
fix download bug when use multi gpus ( #13610 )
2024-08-06 21:15:52 +08:00
b6211b936b
support benchmark for paddlepaddle3.0 ( #13574 )
2024-08-02 19:24:40 +08:00
9c19e6dffe
fix bug for paddlepaddle3.0 ( #13568 )
2024-08-01 22:50:44 +08:00
6c12df47b2
merge release/2.6.1 to main ( #13523 )
2024-07-29 19:09:42 +08:00
428832f6ee
remove some of the less common dependencies ( #13461 )
...
* remove some of the less common dependencies
* remove dependencies
2024-07-24 19:29:58 +08:00
cf26f2330e
Latexocr paddle ( #13401 )
...
* commit_test
* modified: configs/rec/rec_latex_ocr.yml
deleted: ppocr/modeling/backbones/rec_resnetv2.py
* ntuple_solve
* style
* style
* style
* style
* style
* style
* style
* style
* style
* delete comment
* cla_email
2024-07-22 11:50:23 +08:00
820c240593
add bn_dict.txt ( #13373 )
...
* add bn_dict.txt
* add new line at the end of file
2024-07-13 08:30:45 +08:00
024da2a58c
unifying data types in the SLAHead ( #13276 )
2024-07-06 22:01:06 +08:00
62f5602cc8
fix pr11999 about slanet train error. ( #13073 )
2024-06-17 11:32:39 +08:00
24f06d1a1b
update common pre-commit configs and commit the results of running pre-commit run -a ( #12516 )
2024-05-29 15:26:09 +08:00
ea29b423d5
fix and enable flake8 E721 ( #12258 )
2024-05-27 11:12:05 +08:00
a2ad2124c7
commit fix by running pre-commit run -a ( #12165 )
2024-05-24 12:12:42 +08:00
af87691591
add ci for paddleocr test ( #12062 )
...
* add ci for paddleocr test
* fix flake8 error
* fix paddlepaddle deps
* add dep
* fix
* move flake8 to pre-commit
* update ut
* fix bug
* fix bug set paddlepaddle==2.5
* fix bug
* fix bug
* fix bug
* update test
* remove lscpu
2024-05-22 13:02:24 +08:00
579d0c34d4
Added Bengali , gujrati and kazakh dictionary ( #12151 )
2024-05-22 10:12:38 +08:00
f5defabb60
fix the issue of repeatedly downloading pretrained model ( #12142 )
...
* fix the issue of repeatedly downloading pretrained model
* add log info
2024-05-20 19:22:45 +08:00
502e1675e4
Error with pyclipper inhomogeneous expanded array ( #12108 )
...
* pyclipper inhomogeneous expanded array solved
For some images, `np.array(offset.Execute(distance))` can result in inhomogeneous part of the detection box list, which cannot be casted into numpy array directly.
* corrected box reshape position
- box reshape was mistakenly done at line 145 which is now correctly done at line 92 of `db_postprocess.py`
- if box is empty then continue
* reverted mistakenly changed line 147
- reverted mistakenly changed `box.array(box)` to `np.array(box)`
* expanded array fix for `det_box_type=quad`
* polygons padding
For `--det_box_type = poly`, pad the detected polygon arrays if they have different shapes to ensure even shapes of polygon arrays
* fix codestyle
---------
Co-authored-by: Wang Xin <xinwang614@gmail.com>
2024-05-18 09:19:06 +08:00
8b71785141
table rec code ( #11999 )
...
* table rec code
* 'fixtableinit'
* copyright 2024
* table rec pre-commit
* table rec slanet_lcnetv2 doc
* table rec slanet_lcnetv2 doc
* hwattention fix
* tablelabelencode add length item
2024-05-16 15:32:24 +08:00
38c0c9ee77
openocr compti code ( #12033 )
...
* openocr compti code
* update config and repsvtr
* svtrv2 doc
2024-05-15 14:40:26 +08:00
95e3103f88
Burmese Language dict and corpus ( #12020 )
...
* updated bm_dict
* ppocr/utils/dict/README.md added
* minor fix
---------
Co-authored-by: Zhang Jun <jzhang533@gmail.com>
2024-04-30 15:15:14 +08:00
a730065e7b
【OCR Issue No.9】以可选形式支持Visualdl ( #11947 )
...
* delete visual dl
* totally delete visual
* delete vdl file
* fix codestyle
2024-04-25 17:37:27 +08:00
045e5f6ac7
add pre-commit workflow ( #11973 )
...
* add pre-commit workflow
* run 'pre-commit run --all-files'
* setup python version
2024-04-21 21:46:20 +08:00
2b3b3554c0
use tensor.shape bug not paddle.shape(tensor) ( #11919 )
...
* use tensor.shape bug not paddle.shape(tensor)
* refine
* refine
2024-04-17 10:54:59 +08:00
fa93f61cc5
fix: Correct misuse of `try_import` from `paddle.utils` ( #11820 )
...
This commit addresses the incorrect usage of the `try_import` function from `paddle.utils` in both `ppocr/utils/utility.py` and `ppstructure/pdf2word/pdf2word.py`.
2024-03-28 11:26:36 +08:00
8c9d3f91b1
adapter new type promotion rule for Paddle 2.6 ( #11698 )
2024-03-18 11:55:55 +08:00
b583b4773f
cherry-pick for lazy import pymupdf and pre-commit ( #11692 )
...
Co-authored-by: jzhang533 <jzhang533@gmail.com>
2024-03-13 12:34:31 +08:00
1f6712c370
Update zeros' comment in rec_abinet_head.py ( #11374 )
...
Bug fixes | One of code comments | maybe here it's B,N,C
2023-12-27 19:45:24 +08:00
0382bfb02d
Optimize prediction on long image and deduplicate similar boxes with multiple lables ( #11366 )
...
* Handle conflict where a box is simultaneously recognized as multiple labels
* Split large height image recursively and process each with overlap to enhance performance
* Fix error when dt_box result is empty
* Add split operation on horizon side
* Slide on horizon may suffer line completeness, so that add more strict condition.
* Optimize recognition of overlap boxes.
2023-12-21 10:32:42 +08:00
c708180ce9
fix bug for rec_postprocess.py ( #11389 )
...
Co-authored-by: xueyadong <xueyadong@baidu.com>
2023-12-19 11:06:25 +08:00
bf6b100f85
update uygur dict ( #11125 )
2023-10-26 15:32:55 +08:00
987b3112cd
valid_out ( #11126 )
2023-10-25 15:35:10 +08:00
bf59c42a0f
fix satrn export for paddle2.5 ( #11096 )
2023-10-19 15:00:11 +08:00
e3fc6393e0
[Cherry-pick] Cherry-pick from release/2.6 ( #11092 )
...
* Update recognition_en.md (#10059 )
ic15_dict.txt only have 36 digits
* Update ocr_rec.h (#9469 )
It is enough to include preprocess_op.h, we do not need to include ocr_cls.h.
* 补充num_classes注释说明 (#10073 )
ser_vi_layoutxlm_xfund_zh.yml中的Architecture.Backbone.num_classes所赋值会设置给Loss.num_classes，
由于采用BIO标注，假设字典中包含n个字段（包含other）时，则类别数为2n-1;假设字典中包含n个字段（不含other）时，则类别数为2n+1。
* Update algorithm_overview_en.md (#9747 )
Fix links to super-resolution algorithm docs
* 改进文档`deploy/hubserving/readme.md`和`doc/doc_ch/models_list.md` (#9110 )
* Update readme.md
* Update readme.md
* Update readme.md
* Update models_list.md
* trim trailling spaces @ `deploy/hubserving/readme_en.md`
* `s/shell/bash/` @ `deploy/hubserving/readme_en.md`
* Update `deploy/hubserving/readme_en.md` to sync with `deploy/hubserving/readme.md`
* Update deploy/hubserving/readme_en.md to sync with `deploy/hubserving/readme.md`
* Update deploy/hubserving/readme_en.md to sync with `deploy/hubserving/readme.md`
* Update `doc/doc_en/models_list_en.md` to sync with `doc/doc_ch/models_list_en.md`
* using Grammarly to weak `deploy/hubserving/readme_en.md`
* using Grammarly to tweak `doc/doc_en/models_list_en.md`
* `ocr_system` module will return with values of field `confidence`
* Update README_CN.md
* 修复测试服务中图片转Base64的引用地址错误。 (#8334 )
* Update application.md
* [Doc] Fix 404 link. (#10318 )
* Update PP-OCRv3_det_train.md
* Update knowledge_distillation.md
* Update config.md
* Fix fitz camelCase deprecation and .PDF not being recognized as pdf file (#10181 )
* Fix fitz camelCase deprecation and .PDF not being recognized as pdf file
* refactor get_image_file_list function
* Update customize.md (#10325 )
* Update FAQ.md (#10345 )
* Update FAQ.md (#10349 )
* Don't break overall processing on a bad image (#10216 )
* Add preprocessing common to OCR tasks (#10217 )
Add preprocessing to options
* [MLU] add mlu device for infer (#10249 )
* Create newfeature.md
* Update newfeature.md
* remove unused imported module, so can avoid PyInstaller packaged binary's start-time not found module error. (#10502 )
* CV套件建设专项活动 - 文字识别返回单字识别坐标 (#10515 )
* modification of return word box
* update_implements
* Update rec_postprocess.py
* Update utility.py
* Update README_ch.md
* revert README_ch.md update
* Fixed Layout recovery README file (#10493 )
Co-authored-by: Shubham Chambhare <shubhamchambhare@zoop.one>
* update_doc
* bugfix
---------
Co-authored-by: ChuongLoc <89434232+ChuongLoc@users.noreply.github.com>
Co-authored-by: Wang Xin <xinwang614@gmail.com>
Co-authored-by: tanjh <dtdhinjapan@gmail.com>
Co-authored-by: Louis Maddox <lmmx@users.noreply.github.com>
Co-authored-by: n0099 <n@n0099.net>
Co-authored-by: zhenliang li <37922155+shouyong@users.noreply.github.com>
Co-authored-by: itasli <ilyas.tasli@outlook.fr>
Co-authored-by: UserUnknownFactor <63057995+UserUnknownFactor@users.noreply.github.com>
Co-authored-by: PeiyuLau <135964669+PeiyuLau@users.noreply.github.com>
Co-authored-by: kerneltravel <kjpioo2006@gmail.com>
Co-authored-by: ToddBear <43341135+ToddBear@users.noreply.github.com>
Co-authored-by: Ligoml <39876205+Ligoml@users.noreply.github.com>
Co-authored-by: Shubham Chambhare <59397280+Shubham654@users.noreply.github.com>
Co-authored-by: Shubham Chambhare <shubhamchambhare@zoop.one>
Co-authored-by: andyj <87074272+andyjpaddle@users.noreply.github.com>
2023-10-18 17:37:23 +08:00
6abf08a06e
fix import collection for py310 ( #11012 )
2023-09-27 15:40:16 +08:00
e49e491417
add svtr large model ( #10937 )
...
* add svtr large model
* [WIP]add svtr large model
2023-09-26 14:38:29 +08:00
2751cb3a11
fix `cls_x` and `bbox_x` is possibly unbound ( #10991 )
2023-09-25 17:15:09 +08:00
8a52c99ad8
[New] add rec CPPD model ( #10990 )
...
* fix gris_sample data type bug when use fp16
* fix gris_sample data type bug when use fp16
* fix v4rec batchsize
* fix bug of hang when multi gpus training(sampler)
* add rec algorithm cppd
* delete cppd useless code
* update cppd bug
* add rec algorithm cppd
* update cppd trainedmodel url
* add cppd en doc
2023-09-25 15:43:45 +08:00
5d68082518
rm fluid for paddle dev ( #10931 )
2023-09-19 10:16:35 +08:00
75d16610f4
Add new recognition method "ParseQ" ( #10836 )
...
* Update PP-OCRv4_introduction.md
* Update PP-OCRv4_introduction.md (#10616 )
* Update PP-OCRv4_introduction.md
* Update PP-OCRv4_introduction.md
* Update PP-OCRv4_introduction.md
* Update README.md
* Cherrypicking GH-10217 and GH-10216 to PaddlePaddle:Release/2.7 (#10655 )
* Don't break overall processing on a bad image
* Add preprocessing common to OCR tasks
Add preprocessing to options
* Update requirements.txt (#10656 )
added missing pyyaml library
* [TIPC]update xpu tipc script (#10658 )
* fix-typo (#10642 )
Co-authored-by: Dennis <dvorst@users.noreply.github.com>
Co-authored-by: shiyutang <34859558+shiyutang@users.noreply.github.com>
* 修改数据增强导致的DSR报错 (#10662 ) (#10681 )
* 修改数据增强导致的DSR报错
* 错误修改回滚
* Update algorithm_overview_en.md (#10670 )
Fixed simple spelling errors.
* Implement recoginition method ParseQ
* Document update for new recognition method ParseQ
* add prediction for parseq
* Update rec_vit_parseq.yml
* Update rec_r31_sar.yml
* Update rec_r31_sar.yml
* Update rec_r50_fpn_srn.yml
* Update rec_vit_parseq.py
* Update rec_vit_parseq.yml
* Update rec_parseq_head.py
* Update rec_img_aug.py
* Update rec_vit_parseq.yml
* Update __init__.py
* Update predict_rec.py
* Update paddleocr.py
* Update requirements.txt
* Update utility.py
* Update utility.py
---------
Co-authored-by: xiaoting <31891223+tink2123@users.noreply.github.com>
Co-authored-by: topduke <784990967@qq.com>
Co-authored-by: dyning <dyning.2003@163.com>
Co-authored-by: UserUnknownFactor <63057995+UserUnknownFactor@users.noreply.github.com>
Co-authored-by: itasli <ilyas.tasli@outlook.fr>
Co-authored-by: Kai Song <50285351+USTCKAY@users.noreply.github.com>
Co-authored-by: dvorst <87502756+dvorst@users.noreply.github.com>
Co-authored-by: Dennis <dvorst@users.noreply.github.com>
Co-authored-by: shiyutang <34859558+shiyutang@users.noreply.github.com>
Co-authored-by: Dec20B <1192152456@qq.com>
Co-authored-by: ncoffman <51147417+ncoffman@users.noreply.github.com>
2023-09-07 16:36:47 +08:00
zhangyubo0722
Liu Jiaxuan
WangZhen
johnlockejrr
Sunflower7788
liuhongen1234567
Songling Huang
Wang Xin
changdazhou
Taeef Najib
WangZ
jzhang533
Muhammad Asif
Sanjay Rijal
Miaomiao Zhao
topduke
Ichimaru Gin
张春乔
wanghuancoder
NeterOster
zxcd
xiaoting
Yesir
marswen
Xue Yadong
fzhi
shiyutang
Nyakku Shigure
ToddBear