* loss
* fix
* add img2lmdb and test files
* update
* add reference
* fix lint
* fix typo
* use total_numer instead to fit mmocr's lmdbloader
* reorganize and update
* fix lint
* update test file
* refactor and update
* fix test
* update doc in tools
* fix lint
* update old lmdb test file
* update
* mask the unittest for recog2lmdb and use json format for label_only
* remove if __name__
* fix case, doc, typo, formats
* fix typos
* fix docs and variable names
* Apply suggestions from code review
Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>
* update test_loader.py and fix a bug
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>
* [Enhancement] Add windows CI
* [Enhancement] Add windows CI
* update
* update
* update
* [Fix] using assert will keep lmdb file opend and fail to cleanup in test_loader.py
* [Fix] map size should be small on windows in lmdb_util.py
* [Fix] Fix some bugs
* [Fix] Fix some bugs
* [Fix] Fix some bugs
* remove comments & fix bugs
Co-authored-by: Mountchicken <mountchicken@outlook.com>
* update ner standard code format
* add pytest
* fix pre-commit
* Annotate the dataset section
* fix pre-commit for dataset
* rm big files and add comments in dataset
* rename configs for ner task
* minor changes if metric
* Note modification
* fix pre-commit
* detail modification
* rm transform
* rm magic number
* fix warnings in pylint
* fix pre-commit
* correct help info
* rename model files
* rename err fixed
* 428_tag
* Adjust to more general pipline
* update unit test rate
* update
* Unit test coverage over 90% and add Readme
* modify details
* fix precommit
* update
* fix pre-commit
* update
* update
* update
* update result
* update readme
* update baseline config
* update config and small minor changes
* minor changes in readme and etc.
* back to original
* update toy config
* upload model and log
* fix pytest
* Modify the notes.
* fix readme
* Delete Chinese punctuation
* add demo and fix some logic and naming problems
* add To_tensor transformer for ner and load pretrained model in config
* delete extra lines
* split ner loss to MaskedCrossEntropyLoss and MaskedFocalLoss
* update config
* fix err
* updata
* modify noqa
* update new model report
* fix err in ner demo
* Update ner_dataset.py
* Update test_ner_dataset.py
* Update ner_dataset.py
* Update ner_transforms.py
* rm toy config and data
* add comment
* add empty
* fix conflict
* fix precommit
* fix pytest
* fix pytest err
* Update ner_dataset.py
* change dataset name to cluener2020
* move the postprocess in metric to convertor
* rm __init__ etc.
* precommit
* add discription in loss
* add auto download
* add http
* update
* remove some 'issert'
* replace unsqueeze
* update config
* update doc and bert.py
* update
* update demo code
Co-authored-by: weihuaqiang <weihuaqiang@sensetime.com>
Co-authored-by: Hongbin Sun <hongbin306@gmail.com>
* Improve KIE
* allow data do not contain label
* Make relation float32
Signed-off-by: lizz <lizz@sensetime.com>
* Add test
Signed-off-by: lizz <lizz@sensetime.com>
* fix#122: textsnake targets adaptation
* fix#122: textsnake targets adaptation
* add unittest
* fix format
* fix textsnake unittest on cpu
* fix unit test coverage
* add unit test