Commit Graph

34 Commits (9c76f7b5cc040f69576ab80c54f84ff61cb580b4)

Author SHA1 Message Date
Tong Gao 969c65165f
[Fix] Remove depreciated pretrained in kie_test_imgs (#381) 2021-07-21 15:18:59 +08:00
Tong Gao 4f7270e574
Fix #282: Support init_cfg & update depreciated configs (#365)
* update coco ref

* init_cfg for dbnet

* initcfg for mask_rcnn

* textsnake init_cfg

* fix dbnet

* panet initcfg

* psenet initcfg

* fcenet initcfg

* drrg initcfg

* add init_cfg to detectors

* update maskrcnn config file to support mmdet

* fix init_cfg of fce_head

* crnn initcfg

* init_weights in training

* nrtr initcfg

* robust_scanner initcfg

* sar init_cfg

* seg init_cfg

* tps_crnn init_cfg

* sdmgr initcfg

* ner init_cfg

* fix textsnake

* sdmgr initcfg

* move "pretrained" to "init_cfg" for config files

* Moduleslist update

* fix seg

* ner init_cfg

* fix base

* fix encode decode recognizer

* revert dbnet config

* fix crnn

* fix base.py

* fix robust_scanner

* fix panet

* fix test

* remove redundant init_weights() in fcehead

* clean up

* relex mmdet version in workflow

* Add dependency version check

* Update mmocr/models/textdet/dense_heads/pse_head.py

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-07-20 23:18:25 +08:00
Tong Gao 884755d05d
Fix #112: Remove the need of drop_orientation_info in data preprocessing steps (#375)
* ctw1500 ignore orientation

* restore maskrcnn config

* ignore_orientation support for icdar datasets

* update docs

* ignore orientation for total text

* Add LoadOCRImageFromFile

* Fix typo

* simplify design

* remove LoadOCRImageFromFile

* update chinese docs
2021-07-20 23:02:25 +08:00
Tong Gao 02e3b98684
fix syntext_converter (#361) 2021-07-12 02:07:50 +00:00
quincylin1 243f47dc03
add totaltext for recog and det (#357)
* add totaltext for recog and det

* add setup

* fix doc

* fix based on comments
2021-07-08 21:52:50 +08:00
Tong Gao 68df4fbe80
[Feature] Add synthtext converter and update docs (#351)
* Add synthtext converter and update docs

* minor docs fix
2021-07-07 15:54:29 +08:00
Antonio Lanza 19aefa1ae1
Added support for ConcatDataset with two workflows (#348) 2021-07-06 16:37:37 +08:00
AllentDan 97ac619e68
[Fix] Fix unit tests, remove temporary files (#328)
* fix unit tests, remove temp files

* use tempfile package and fix typo

* all files clear
2021-06-26 22:51:50 +08:00
lizz 8999c56159
Fix kie_test_imgs script for novisual (#319)
* Fix kie_test_imgs script for novisual

Signed-off-by: lizz <lizz@sensetime.com>

* Fix test

Signed-off-by: lizz <lizz@sensetime.com>
2021-06-24 07:22:34 +00:00
Hongbin Sun 82f64a5b62
support batch inference during testing (#310)
* support batch inference during testing

* fix unittest

* update docs using url

* set cfg for train, val and test

* update docs

* update docs and test.py

* samples_per_gpu as global setting

* changes revert
2021-06-23 11:34:29 +08:00
GT e6cb750922
add TextOCR dataset converter (#293)
* textocr converter for text recog

* textocr converter for text detection

* update documentation

* remove unnecessary garbage collection lines

* multi-processing textocr converter

* json->mmcv, fix documentation
2021-06-21 03:06:10 +00:00
AllentDan f1b003ddb1
[Feature] Add deployment evaluation (#291)
* add deployment evaluation

* fix lint

* remove cpu unit tests for trt and onnx

* use pytest.mark to skip cpu unit test

* move to mmocr/core

* emm... renamed to wrappers

* renamed to deploy_utils

* renamed unit test to test_deploy_utils

* fix lint

* using pytest.mark.importorskip
2021-06-18 12:27:10 +08:00
AllentDan d57f279083
[Fix] Correct isort setup (#288)
* isort

* remove tools from setup.cfg
2021-06-16 19:44:01 +08:00
Hongbin Sun 87a7dcee0a
fix #279: save detect results (#281)
* fix #279: save detect results

* rename

* set device as arg

* rm bash file
2021-06-15 18:30:09 +08:00
AllentDan 0131b3290f
[Feature] Add onnx and tensorrt export tool (#278)
* add onnx and tensorrt export

* fix lint

* delete batch input to avoid dbnet error

* resolve unittest

* fix lint

* export unittest
2021-06-15 07:51:36 +00:00
quincylin1 d7fa9544e6
added totaltext recog converter (#273)
* added totaltext recog converter

* modified datasets.md and totaltext_converter.py

* added Note to datasets.md

* deleted comments
2021-06-11 11:09:35 +08:00
lizz bb4447585f
Add benchmark_processing script (#261)
* Flush data script

Signed-off-by: lizz <lizz@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* rename to benchmark_processing

Signed-off-by: lizz <lizz@sensetime.com>

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
2021-06-09 17:38:53 +08:00
quincylin1 271129f812
Feature/iss 262 (#266)
* fix issue#262

* fix #262: modified totaltext_converter and added totaltext for datasets.md

* fix issue#262: modified datasets.md

* fix issue#262: removed download json

* Update totaltext_converter.py

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-06-08 13:13:22 +00:00
Hongbin Sun 4882c8a317
dataset preparation docs (#255) 2021-06-01 21:59:40 +08:00
lizz b10b6408ef
Add list_from_file and list_to_file (#226)
* Add list_from_file and list_to_file

Signed-off-by: lizz <lizz@sensetime.com>

* Add test list_to_file and list_from_file

* more

* Fix tests
2021-05-24 06:01:42 +00:00
lizz e0e0e648fd
Support cpu in kie visulization (#215)
Signed-off-by: lizz <lizz@sensetime.com>
2021-05-18 21:48:16 +08:00
lizz 491866ea27
Make tools executable (#209)
Signed-off-by: lizz <lizz@sensetime.com>
2021-05-18 15:19:08 +08:00
lizz 06b75780a0
Fix typos (#207)
Signed-off-by: lizz <lizz@sensetime.com>
2021-05-18 05:44:52 +00:00
hq_wei 24c590bb04
Ner task (#148)
* update ner standard code format

* add pytest

* fix pre-commit

* Annotate the dataset section

* fix pre-commit for dataset

* rm big files and add comments in dataset

* rename configs for ner task

* minor changes if metric

* Note modification

* fix pre-commit

* detail modification

* rm transform

* rm magic number

* fix warnings in pylint

* fix pre-commit

* correct help info

* rename model files

* rename err fixed

* 428_tag

* Adjust to more general pipline

* update unit test rate

* update

* Unit test coverage over 90% and add Readme

* modify details

* fix precommit

* update

* fix pre-commit

* update

* update

* update

* update result

* update readme

* update baseline config

* update config and small minor changes

* minor changes in readme and etc.

* back to original

* update toy config

* upload model and log

* fix pytest

* Modify the notes.

* fix readme

* Delete Chinese punctuation

* add demo and fix some logic and naming problems

* add To_tensor transformer for ner and load pretrained model in config

* delete extra lines

* split ner loss to MaskedCrossEntropyLoss and MaskedFocalLoss

* update config

* fix err

* updata

* modify noqa

* update new model report

* fix err in ner demo

* Update ner_dataset.py

* Update test_ner_dataset.py

* Update ner_dataset.py

* Update ner_transforms.py

* rm toy config and data

* add comment

* add empty

* fix conflict

* fix precommit

* fix pytest

* fix pytest err

* Update ner_dataset.py

* change dataset name to cluener2020

* move the postprocess in metric to convertor

* rm __init__ etc.

* precommit

* add discription in loss

* add auto download

* add http

* update

* remove some 'issert'

* replace unsqueeze

* update config

* update doc and bert.py

* update

* update demo code

Co-authored-by: weihuaqiang <weihuaqiang@sensetime.com>
Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-05-18 11:33:51 +08:00
Hongbin Sun b058fdcb4e
mv data_convert_util to mmocr (#96)
* mv data_convert_util to mmocr

* update

* rm bracket
2021-04-19 21:03:52 +08:00
Hongbin Sun 1a129a1e98
add svt converter (#65)
* add svt converter

* fix str fmt

* fix str fmt

* update convert script
2021-04-14 18:33:14 +08:00
lizz 393ed7fc5a
Implement get_root_logger and train_detector (#4) 2021-04-08 01:24:04 +08:00
lizz 44ca9c2a61
Remove usage of \ (#49)
* Remove usage of \

Signed-off-by: lizz <lizz@sensetime.com>

* rebase

Signed-off-by: lizz <lizz@sensetime.com>

* typos

Signed-off-by: lizz <lizz@sensetime.com>

* Remove test dependency on tools/

Signed-off-by: lizz <lizz@sensetime.com>

* Remove usage of \

Signed-off-by: lizz <lizz@sensetime.com>

* rebase

Signed-off-by: lizz <lizz@sensetime.com>

* typos

Signed-off-by: lizz <lizz@sensetime.com>

* Remove test dependency on tools/

Signed-off-by: lizz <lizz@sensetime.com>

* typo

Signed-off-by: lizz <lizz@sensetime.com>

* KIE in keywords

Signed-off-by: lizz <lizz@sensetime.com>

* some renames

Signed-off-by: lizz <lizz@sensetime.com>

* kill isort skip

Signed-off-by: lizz <lizz@sensetime.com>

* aggregation discrimination

Signed-off-by: lizz <lizz@sensetime.com>

* aggregation discrimination

Signed-off-by: lizz <lizz@sensetime.com>

* tiny

Signed-off-by: lizz <lizz@sensetime.com>

* fix bug: model infer on cpu

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-04-06 12:16:46 +00:00
lizz 09ffd284ee Remove test dependency on tools
Signed-off-by: lizz <lizz@sensetime.com>
2021-04-06 10:57:25 +08:00
Hongbin Sun cb1b2c2fa6
fix #24: rm img_meta from inference (#25) 2021-04-05 18:01:43 +08:00
Hongbin Sun 3727cab712 fix #21: update sdmgr readme and config 2021-04-05 16:09:13 +08:00
Hongbin Sun 9af0bed144 fix #21: refactor kie dataset & add show_results 2021-04-05 16:07:29 +08:00
jeffreykuang 31f1c007c0 [feature]: add textdet 2021-04-03 01:03:52 +08:00
Hongbin Sun 4ecd0cea8a add sar, seg and other components 2021-04-02 23:54:57 +08:00