Commit Graph

126 Commits (914c8af7bf9b48ccf904f126f7bd15e9ee07afac)

Author SHA1 Message Date
lizz 8999c56159
Fix kie_test_imgs script for novisual (#319)
* Fix kie_test_imgs script for novisual

Signed-off-by: lizz <lizz@sensetime.com>

* Fix test

Signed-off-by: lizz <lizz@sensetime.com>
2021-06-24 07:22:34 +00:00
Hongbin Sun 82f64a5b62
support batch inference during testing (#310)
* support batch inference during testing

* fix unittest

* update docs using url

* set cfg for train, val and test

* update docs

* update docs and test.py

* samples_per_gpu as global setting

* changes revert
2021-06-23 11:34:29 +08:00
GT e6cb750922
add TextOCR dataset converter (#293)
* textocr converter for text recog

* textocr converter for text detection

* update documentation

* remove unnecessary garbage collection lines

* multi-processing textocr converter

* json->mmcv, fix documentation
2021-06-21 03:06:10 +00:00
AllentDan f1b003ddb1
[Feature] Add deployment evaluation (#291)
* add deployment evaluation

* fix lint

* remove cpu unit tests for trt and onnx

* use pytest.mark to skip cpu unit test

* move to mmocr/core

* emm... renamed to wrappers

* renamed to deploy_utils

* renamed unit test to test_deploy_utils

* fix lint

* using pytest.mark.importorskip
2021-06-18 12:27:10 +08:00
AllentDan d57f279083
[Fix] Correct isort setup (#288)
* isort

* remove tools from setup.cfg
2021-06-16 19:44:01 +08:00
Hongbin Sun 87a7dcee0a
fix #279: save detect results (#281)
* fix #279: save detect results

* rename

* set device as arg

* rm bash file
2021-06-15 18:30:09 +08:00
AllentDan 0131b3290f
[Feature] Add onnx and tensorrt export tool (#278)
* add onnx and tensorrt export

* fix lint

* delete batch input to avoid dbnet error

* resolve unittest

* fix lint

* export unittest
2021-06-15 07:51:36 +00:00
quincylin1 d7fa9544e6
added totaltext recog converter (#273)
* added totaltext recog converter

* modified datasets.md and totaltext_converter.py

* added Note to datasets.md

* deleted comments
2021-06-11 11:09:35 +08:00
lizz bb4447585f
Add benchmark_processing script (#261)
* Flush data script

Signed-off-by: lizz <lizz@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* Update tools/run_data.py

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>

* rename to benchmark_processing

Signed-off-by: lizz <lizz@sensetime.com>

Co-authored-by: jeffreykuang <kuangzhanghui@sensetime.com>
2021-06-09 17:38:53 +08:00
quincylin1 271129f812
Feature/iss 262 (#266)
* fix issue#262

* fix #262: modified totaltext_converter and added totaltext for datasets.md

* fix issue#262: modified datasets.md

* fix issue#262: removed download json

* Update totaltext_converter.py

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-06-08 13:13:22 +00:00
Hongbin Sun 4882c8a317
dataset preparation docs (#255) 2021-06-01 21:59:40 +08:00
lizz b10b6408ef
Add list_from_file and list_to_file (#226)
* Add list_from_file and list_to_file

Signed-off-by: lizz <lizz@sensetime.com>

* Add test list_to_file and list_from_file

* more

* Fix tests
2021-05-24 06:01:42 +00:00
lizz e0e0e648fd
Support cpu in kie visulization (#215)
Signed-off-by: lizz <lizz@sensetime.com>
2021-05-18 21:48:16 +08:00
lizz 491866ea27
Make tools executable (#209)
Signed-off-by: lizz <lizz@sensetime.com>
2021-05-18 15:19:08 +08:00
lizz 06b75780a0
Fix typos (#207)
Signed-off-by: lizz <lizz@sensetime.com>
2021-05-18 05:44:52 +00:00
hq_wei 24c590bb04
Ner task (#148)
* update ner standard code format

* add pytest

* fix pre-commit

* Annotate the dataset section

* fix pre-commit for dataset

* rm big files and add comments in dataset

* rename configs for ner task

* minor changes if metric

* Note modification

* fix pre-commit

* detail modification

* rm transform

* rm magic number

* fix warnings in pylint

* fix pre-commit

* correct help info

* rename model files

* rename err fixed

* 428_tag

* Adjust to more general pipline

* update unit test rate

* update

* Unit test coverage over 90% and add Readme

* modify details

* fix precommit

* update

* fix pre-commit

* update

* update

* update

* update result

* update readme

* update baseline config

* update config and small minor changes

* minor changes in readme and etc.

* back to original

* update toy config

* upload model and log

* fix pytest

* Modify the notes.

* fix readme

* Delete Chinese punctuation

* add demo and fix some logic and naming problems

* add To_tensor transformer for ner and load pretrained model in config

* delete extra lines

* split ner loss to MaskedCrossEntropyLoss and MaskedFocalLoss

* update config

* fix err

* updata

* modify noqa

* update new model report

* fix err in ner demo

* Update ner_dataset.py

* Update test_ner_dataset.py

* Update ner_dataset.py

* Update ner_transforms.py

* rm toy config and data

* add comment

* add empty

* fix conflict

* fix precommit

* fix pytest

* fix pytest err

* Update ner_dataset.py

* change dataset name to cluener2020

* move the postprocess in metric to convertor

* rm __init__ etc.

* precommit

* add discription in loss

* add auto download

* add http

* update

* remove some 'issert'

* replace unsqueeze

* update config

* update doc and bert.py

* update

* update demo code

Co-authored-by: weihuaqiang <weihuaqiang@sensetime.com>
Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-05-18 11:33:51 +08:00
Hongbin Sun b058fdcb4e
mv data_convert_util to mmocr (#96)
* mv data_convert_util to mmocr

* update

* rm bracket
2021-04-19 21:03:52 +08:00
Hongbin Sun 1a129a1e98
add svt converter (#65)
* add svt converter

* fix str fmt

* fix str fmt

* update convert script
2021-04-14 18:33:14 +08:00
lizz 393ed7fc5a
Implement get_root_logger and train_detector (#4) 2021-04-08 01:24:04 +08:00
lizz 44ca9c2a61
Remove usage of \ (#49)
* Remove usage of \

Signed-off-by: lizz <lizz@sensetime.com>

* rebase

Signed-off-by: lizz <lizz@sensetime.com>

* typos

Signed-off-by: lizz <lizz@sensetime.com>

* Remove test dependency on tools/

Signed-off-by: lizz <lizz@sensetime.com>

* Remove usage of \

Signed-off-by: lizz <lizz@sensetime.com>

* rebase

Signed-off-by: lizz <lizz@sensetime.com>

* typos

Signed-off-by: lizz <lizz@sensetime.com>

* Remove test dependency on tools/

Signed-off-by: lizz <lizz@sensetime.com>

* typo

Signed-off-by: lizz <lizz@sensetime.com>

* KIE in keywords

Signed-off-by: lizz <lizz@sensetime.com>

* some renames

Signed-off-by: lizz <lizz@sensetime.com>

* kill isort skip

Signed-off-by: lizz <lizz@sensetime.com>

* aggregation discrimination

Signed-off-by: lizz <lizz@sensetime.com>

* aggregation discrimination

Signed-off-by: lizz <lizz@sensetime.com>

* tiny

Signed-off-by: lizz <lizz@sensetime.com>

* fix bug: model infer on cpu

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-04-06 12:16:46 +00:00
lizz 09ffd284ee Remove test dependency on tools
Signed-off-by: lizz <lizz@sensetime.com>
2021-04-06 10:57:25 +08:00
Hongbin Sun cb1b2c2fa6
fix #24: rm img_meta from inference (#25) 2021-04-05 18:01:43 +08:00
Hongbin Sun 3727cab712 fix #21: update sdmgr readme and config 2021-04-05 16:09:13 +08:00
Hongbin Sun 9af0bed144 fix #21: refactor kie dataset & add show_results 2021-04-05 16:07:29 +08:00
jeffreykuang 31f1c007c0 [feature]: add textdet 2021-04-03 01:03:52 +08:00
Hongbin Sun 4ecd0cea8a add sar, seg and other components 2021-04-02 23:54:57 +08:00