Commit Graph

41 Commits (67ebc6c876bd4bd79d122cd6d525edfc08f6e37d)

Author SHA1 Message Date
hsiehpinghan a71889aeb4
[Feature] Let ResizeOCR full support mmcv.impad's pad_val parameters (#1437)
* fix #1436: Let ResizeOCR full support mmcv.impad's pad_val parameters

* fix #1436: Let ResizeOCR full support mmcv.impad's pad_val parameters
2022-10-10 11:09:32 +08:00
Tong Gao 1ad4caa7cb
[Enhancement] Allow choosing metrics to report in text recognition tasks (#989)
* [Enhancement] Allow choosing metrics to report in text recognition tasks

* add acc support

* refine docstr
2022-05-05 16:10:38 +08:00
Tong Gao 6b180db93d
[Enhancement] Automatically report mean scores when applicable (#995) 2022-05-05 12:57:19 +08:00
Qing Jiang 92ef554a82
[Feature] Add recog2lmdb and new toy dataset files (#979)
* loss

* fix

* add img2lmdb and test files

* update

* add reference

* fix lint

* fix typo

* use total_numer instead to fit mmocr's lmdbloader

* reorganize and update

* fix lint

* update test file

* refactor and update

* fix test

* update doc in tools

* fix lint

* update old lmdb test file

* update

* mask the unittest for recog2lmdb and use json format for label_only

* remove if __name__

* fix case, doc, typo, formats

* fix typos

* fix docs and variable names

* Apply suggestions from code review

Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>

* update test_loader.py and fix a bug

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>
2022-04-29 22:30:36 +08:00
Qing Jiang d8549ade85
[Feature] Support loading images and labels from lmdb file (#982)
* loss

* fix

* add LoadImageFromLMDB

* update

* new version

* add json

* fix bug

* Compatible with older versions

* modify test_loader

* add docstring and update test_loader

* fix a bug

* fix docstring and update doc

* update

* Update mmocr/datasets/utils/backend.py

Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>

* Update docs/en/tutorials/dataset_types.md

Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>

* fix lint

Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>
2022-04-29 15:46:36 +08:00
Tong Gao 064a2b8c45
[Feature] Support computing mean scores in UniformConcatDataset (#981)
* Get avg results in UniformConcatDataset

* add docstr

* Fix

* fix test

* fix typo
2022-04-29 14:48:21 +08:00
Tong Gao 0c8fa52b22
[Fix] Fix ImgAug transform (#949)
* [Fix] Fix bbox case in ImgAug

* Finialize the augmentation and add tests
2022-04-28 22:52:11 +08:00
Tong Gao 888f700134
[Enhancement] Support dynamic threshold range in eval_hmean (#962)
* [Enhancement] Support dynamic threshold range in eval_hmean

* upgrade textdetdataset, add deprecate warning
2022-04-22 17:07:36 +08:00
garvan2021 b11fa80d82
[Fix] correct meta key (#926)
* correct meta key

* fix test metakey
2022-04-18 09:09:09 +08:00
Hongbin Sun 402e8f1162
[Feature] Support loading annotation file with petrel/http backend (#793)
* add petrel backend for ann_file loading

* support icdar dataset

* add http backend

* name back

* fix pytest

* support load lmdb file on ceph

* refactor

* add close for lmdb

* add log and warning msg

* rename

* typo

* update

* fix
2022-03-07 19:18:02 +08:00
Tong Gao 3110ab7863
[Enhancement] Add windows CI (#790)
* [Enhancement] Add windows CI

* [Enhancement] Add windows CI

* update

* update

* update

* [Fix] using assert will keep lmdb file opend and fail to cleanup in test_loader.py

* [Fix] map size should be small on windows in lmdb_util.py

* [Fix] Fix some bugs

* [Fix] Fix some bugs

* [Fix] Fix some bugs

* remove comments & fix bugs

Co-authored-by: Mountchicken <mountchicken@outlook.com>
2022-03-02 10:34:15 +08:00
Tong Gao 9104667112
[Model] Full ABINet Framework (#651)
Co-authored-by: liukuikun <24622904+Harold-lkk@users.noreply.github.com>
2021-12-15 11:21:54 +08:00
Hongbin Sun a4237ad568
[Enhancement] Support muitiple pipelines for different datasets (#657)
* support multi pipelines

* support different pipelines

* fix

* fix replace_image_to_tensor

* remove redundant check

* update

* add copyright

* not in-place modify
2021-12-14 12:29:43 +00:00
Jianyong Chen 5caa945a8d
fix #614: textsnake targets (#660)
* fix #614: textsnake targets

* fix lint

* add textsnake_targets test cases

* init with eps

* fix test coverage
2021-12-13 17:45:30 +08:00
Hongbin Sun fec986aba0
[Enhancement] Use shape from loaded image (#652)
* use shape from loaded image

* complete unittest

* add params as gate

* add comment

* add assert
2021-12-09 01:34:09 +00:00
Hongbin Sun a50b0c9fb9
[Feature] Support openset kie (#498)
* add openset kie dataset

* updare readme

* add anno convert script

* update docstring

* update script

* add & update docstring

* fix typo

* update docstring format
2021-11-11 14:47:38 +08:00
Tong Gao 0881c2d2a2
[Fix] Add zero division handler in poly utils, remove Polygon3 (#448)
* Add check to avoid zero div in iou computation

* replace polygon3 with shapely

* remove req of Polygon3
2021-08-25 13:14:58 +08:00
Tong Gao b8f7ead74c
[Enhancement] Add copyright info (#439)
* add copyright info
2021-08-17 17:39:30 +08:00
Hongbin Sun 44fed8590b
fix bug: remove tail whitespace from gt label (#358)
* fix bug: remove tail whitespace from gt label

* remove useless

* refactor
2021-07-09 13:24:34 +00:00
Hongbin Sun 20f65fb521
use unifor_concat_datase instead of concat_dataset (#343)
* use unifor_concat_datase instead of concat_dataset

* add unittest for uniform_concat_dataset
2021-07-03 16:03:37 +08:00
lizz 8999c56159
Fix kie_test_imgs script for novisual (#319)
* Fix kie_test_imgs script for novisual

Signed-off-by: lizz <lizz@sensetime.com>

* Fix test

Signed-off-by: lizz <lizz@sensetime.com>
2021-06-24 07:22:34 +00:00
Hongbin Sun 7c4eb7e056
fix #253: speedup; fix assert (#263)
* fix #253: speedup; fix assert

* fix #253: speedup; fix assert

* add unittest for bug fix block
2021-06-23 08:16:57 +00:00
AllentDan d57f279083
[Fix] Correct isort setup (#288)
* isort

* remove tools from setup.cfg
2021-06-16 19:44:01 +08:00
lizz 36e92ebe70
Speed up sort_vertex (#239)
* Speed up sort_vertex

Signed-off-by: lizz <lizz@sensetime.com>

* Fix test

Signed-off-by: lizz <lizz@sensetime.com>
2021-05-25 19:58:05 +08:00
Zyq-scut 8c60e4b4d1
update fcenet (#214)
* update fcenet

* fix typos

* fix
2021-05-18 21:52:34 +08:00
hq_wei 24c590bb04
Ner task (#148)
* update ner standard code format

* add pytest

* fix pre-commit

* Annotate the dataset section

* fix pre-commit for dataset

* rm big files and add comments in dataset

* rename configs for ner task

* minor changes if metric

* Note modification

* fix pre-commit

* detail modification

* rm transform

* rm magic number

* fix warnings in pylint

* fix pre-commit

* correct help info

* rename model files

* rename err fixed

* 428_tag

* Adjust to more general pipline

* update unit test rate

* update

* Unit test coverage over 90% and add Readme

* modify details

* fix precommit

* update

* fix pre-commit

* update

* update

* update

* update result

* update readme

* update baseline config

* update config and small minor changes

* minor changes in readme and etc.

* back to original

* update toy config

* upload model and log

* fix pytest

* Modify the notes.

* fix readme

* Delete Chinese punctuation

* add demo and fix some logic and naming problems

* add To_tensor transformer for ner and load pretrained model in config

* delete extra lines

* split ner loss to MaskedCrossEntropyLoss and MaskedFocalLoss

* update config

* fix err

* updata

* modify noqa

* update new model report

* fix err in ner demo

* Update ner_dataset.py

* Update test_ner_dataset.py

* Update ner_dataset.py

* Update ner_transforms.py

* rm toy config and data

* add comment

* add empty

* fix conflict

* fix precommit

* fix pytest

* fix pytest err

* Update ner_dataset.py

* change dataset name to cluener2020

* move the postprocess in metric to convertor

* rm __init__ etc.

* precommit

* add discription in loss

* add auto download

* add http

* update

* remove some 'issert'

* replace unsqueeze

* update config

* update doc and bert.py

* update

* update demo code

Co-authored-by: weihuaqiang <weihuaqiang@sensetime.com>
Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-05-18 11:33:51 +08:00
Jianyong Chen 2414c65577
Add drrg (#189)
* merge drrg

* directory structure&fix redundant import

* docstrings

* fix isort

* drrg readme

* merge drrg

* directory structure&fix redundant import

* docstrings

* fix isort

* drrg readme

* add unittests&fix docstrings

* revert test_loss

* add unittest

* add unittests

* fix docstrings

* fix docstrings

* fix yapf

* fix yapf

* Update test_textdet_head.py

* Update test_textdet_head.py

* add unittests

* add unittests

* add unittests

* fix docstrings

* fix docstrings

* fix docstring

* fix unittests

* fix pytest

* fix pytest

* fix pytest

* fix variable names

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-05-18 11:15:47 +08:00
Zyq-scut cbdd98a1e1
add fcenet (#133)
* add fcenet

* fix linting and code style

* fcenet finetune

* Update transforms.py

* Update fcenet_r50dcnv2_fpn_1500e_ctw1500.py

* Update fcenet_targets.py

* Update fce_loss.py

* fix

* add readme

* fix config

* Update fcenet_r50dcnv2_fpn_1500e_ctw1500.py

* fix

* fix readme

* fix readme

* Update test_loss.py

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-05-14 21:37:04 +08:00
jeffreykuang 47896a3f80
Unit tests of dbnet transform (#163)
* Add unit test for dbnet transforms

* Add unit test for dbnet transforms

* Add unit test for dbnet transforms
2021-05-11 15:21:14 +08:00
lizz 5054a3f78d
Implement iter protocol for Loader (#150)
* Implement iter protocal for Loader

Signed-off-by: lizz <lizz@sensetime.com>

* Test iter protocal

Signed-off-by: lizz <lizz@sensetime.com>
2021-05-06 09:51:29 +00:00
lizz 47965516f0
Improve KIE (#153)
* Improve KIE
* allow data do not contain label
* Make relation float32

Signed-off-by: lizz <lizz@sensetime.com>

* Add test

Signed-off-by: lizz <lizz@sensetime.com>
2021-05-06 09:51:10 +00:00
Jianyong Chen e29b5b8abe
Fix issue 122 (#130)
* fix #122: textsnake targets adaptation

* fix #122: textsnake targets adaptation

* add unittest

* fix format

* fix textsnake unittest on cpu

* fix unit test coverage

* add unit test
2021-04-29 11:02:57 +08:00
Hongbin Sun 43dcb32d4f
Hbsun/end2end demo (#105)
* add end2end demo

* fix typo

* pad box

* fix bug of crnn

* fix polygon

* update docstring

* fix bug of polygon

* updare demo api

* fix except

* rename

* fix with comments
2021-04-22 20:42:42 +08:00
lizz 44ca9c2a61
Remove usage of \ (#49)
* Remove usage of \

Signed-off-by: lizz <lizz@sensetime.com>

* rebase

Signed-off-by: lizz <lizz@sensetime.com>

* typos

Signed-off-by: lizz <lizz@sensetime.com>

* Remove test dependency on tools/

Signed-off-by: lizz <lizz@sensetime.com>

* Remove usage of \

Signed-off-by: lizz <lizz@sensetime.com>

* rebase

Signed-off-by: lizz <lizz@sensetime.com>

* typos

Signed-off-by: lizz <lizz@sensetime.com>

* Remove test dependency on tools/

Signed-off-by: lizz <lizz@sensetime.com>

* typo

Signed-off-by: lizz <lizz@sensetime.com>

* KIE in keywords

Signed-off-by: lizz <lizz@sensetime.com>

* some renames

Signed-off-by: lizz <lizz@sensetime.com>

* kill isort skip

Signed-off-by: lizz <lizz@sensetime.com>

* aggregation discrimination

Signed-off-by: lizz <lizz@sensetime.com>

* aggregation discrimination

Signed-off-by: lizz <lizz@sensetime.com>

* tiny

Signed-off-by: lizz <lizz@sensetime.com>

* fix bug: model infer on cpu

Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
2021-04-06 12:16:46 +00:00
Theo Chan cbb4ec349b
Textsnake tests (#51)
* add textsnake unit tests
2021-04-06 18:20:43 +08:00
Hongbin Sun fbb5c8cda1
fix #40: add unit test for recog config, transforms, etc. (#44) 2021-04-06 07:17:20 +00:00
lizz 09ffd284ee Remove test dependency on tools
Signed-off-by: lizz <lizz@sensetime.com>
2021-04-06 10:57:25 +08:00
lizz 2ad699e099 fix
Signed-off-by: lizz <lizz@sensetime.com>
2021-04-06 10:57:25 +08:00
Hongbin Sun 0f00378f9a
Feature/iss 33 (#34)
* fix #33: update dataset.md

* fix #33: pytest for transformer related
2021-04-05 23:54:57 +08:00
jeffreykuang 31f1c007c0 [feature]: add textdet 2021-04-03 01:03:52 +08:00
Hongbin Sun 4ecd0cea8a add sar, seg and other components 2021-04-02 23:54:57 +08:00