Commit Graph

132 Commits (c7a4298c3227fcec1758ad32a4023071f0893a00)

Author SHA1 Message Date
Tong Gao c7a4298c32
[Fix] Replace mmcv.fileio with mmengine (#1292) 2022-08-19 16:53:14 +08:00
Tong Gao 97f6c1d5d6
[Fix] Fix browse_dataset (#1271) 2022-08-10 17:48:49 +08:00
liukuikun 37ff38e7aa
[Fix] fix base name and dist_xx (#1253)
* fix base name and dist_xx

* update registry
2022-08-04 15:25:54 +08:00
liukuikun 1b33ff5d76 [Feat] support fp16 auto resume and auto scale lr 2022-07-21 10:58:03 +08:00
wangxinyu 20e999e3b9 [Tools] Update tools dir structure 2022-07-21 10:58:02 +08:00
gaotongxiao eb2d5b525a Migrate part of old_tests 2022-07-21 10:57:31 +08:00
xinyu efd81b7a5a fix bug 2022-07-21 10:57:17 +08:00
liukuikun d50d2a46eb [Processing]remove segocr and split processing 2022-07-21 10:57:17 +08:00
jiangqing.vendor ee1212a5cd [TODO] update recog data_migrator 2022-07-21 10:57:17 +08:00
xinyu 23e1f2432a update utils 2022-07-21 10:57:16 +08:00
wangxinyu de78a8839f Remove useless 2022-07-21 10:55:46 +08:00
wangxinyu 8313e698d2 [Feature] Add offline eval script 2022-07-21 10:51:04 +08:00
xinke-wang 24575de140 init 2022-07-21 10:51:03 +08:00
gaotongxiao 1af7f94a63 P3: Update textdet data conversion scripts 2022-07-21 10:51:01 +08:00
jiangqing.vendor 8ac235677e [Update] Update data_migrator to suit MJ dataset 2022-07-21 10:51:00 +08:00
jiangqing.vendor 22d90301b8 [Tool] Add browse_dataset 2022-07-21 10:50:59 +08:00
liukuikun a379d086f1 fix some bug 2022-07-21 10:50:59 +08:00
liukuikun fe43259a05 [Refactor] train and test 2022-07-21 10:50:59 +08:00
Mountchicken 4246b1eaee update 2022-07-21 10:50:59 +08:00
gaotongxiao df2f7b69db Add recognition data migrator 2022-07-21 10:50:57 +08:00
gaotongxiao 6a260514e8 Add coco data migrator for detection 2022-07-21 10:50:57 +08:00
gaotongxiao 536dfdd4bd Add PyUpgrade pre-commit hook 2022-07-21 10:50:56 +08:00
liukuikun a90b9600ce [Refactor] refactor DATASETS and TRANSFORMS 2022-07-21 10:50:55 +08:00
leezeeyee 4c1790b3c6
[Fix] fix typo of --lmdb-map-size default value (#1147)
* fix typo of --lmdb-map-size default value

* fix

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2022-07-16 21:32:15 +08:00
#W[_t 1bd26f24ba
[Fix]: access params by cfg.get (#1145)
cfg.get is better way to access the params when it may not exist.
2022-07-11 19:04:05 +08:00
rpb 7800e13fc2
[Fix] Flexible ways of getting file name (#1107)
* Flexible ways of getting file name

Address issue https://github.com/open-mmlab/mmocr/issues/1078

* fix lint

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2022-07-04 11:39:58 +08:00
xiefeifeihu 1f888c9e97
[Fix] Incorrect filename in labelme_converter.py (#1103)
filename value is "img_path_warpped_img" not "img_path_cropped_img" in line 120.
2022-06-22 22:05:45 +08:00
Xinyu Wang 13986f497d
[Feature] Add ArT (#1006)
* add art

* fix typo
2022-05-17 23:59:15 +08:00
Qing Jiang de2851e3c2
[Feature] Add HierText converter (#948)
* loss

* fix

* [feature] add hiertext

* fix name

* update docs

* update

* update markdown

* update doc

* update doc

* update docs
2022-05-05 16:31:36 +08:00
Xinyu Wang b4678eb657
[Fix] Fix Data Converter Issues (#955)
* fix naf mask issue; fix lv path issue

* fix path

* fix ic13, ic11 path issue; fix cocotextv2 mask issue

* fix funsd format
2022-05-05 14:09:05 +08:00
Hongbin Sun a2d741b8a7
[Feature] Add labelme converter for textdet and textrecog (#972)
* add labelme converter

* move to common

* add labelme sample annos

* add doc

* remove useless field generated by labelme to reduce size

* add recog_format option; add skip ignored instances while cropping

* set warp as false by default

* update doc

* fix typo

Co-authored-by: xinke-wang <wangxinyu2017@gmail.com>
Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>
2022-05-03 17:28:22 +08:00
Qing Jiang 92ef554a82
[Feature] Add recog2lmdb and new toy dataset files (#979)
* loss

* fix

* add img2lmdb and test files

* update

* add reference

* fix lint

* fix typo

* use total_numer instead to fit mmocr's lmdbloader

* reorganize and update

* fix lint

* update test file

* refactor and update

* fix test

* update doc in tools

* fix lint

* update old lmdb test file

* update

* mask the unittest for recog2lmdb and use json format for label_only

* remove if __name__

* fix case, doc, typo, formats

* fix typos

* fix docs and variable names

* Apply suggestions from code review

Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>

* update test_loader.py and fix a bug

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
Co-authored-by: Xinyu Wang <45810070+xinke-wang@users.noreply.github.com>
2022-04-29 22:30:36 +08:00
Xinyu Wang 06b73cf71a
[Fix] Fix TotalText Anno version issue (#945)
* fix tt converter version issue; fix typos in docs

* remove incorrect descriptions

* fix docstring & incorrect file name

* fix docstring identation
2022-04-23 23:57:21 +08:00
Xinyu Wang 9c54e7eb00
[Feature] Add RCTW dataset converter (#914)
* add rctw

* fix typos
2022-04-18 09:27:18 +08:00
Tong Gao b4a9a87eee
[Enhancement] More customizable fields in dataloaders (#933)
* [Enhancement] More customizable fields in val and test dataloaders

* update default_loader_cfg
2022-04-18 09:24:07 +08:00
Xinyu Wang 20fc909fc4
[Feature] Add LSVT Data Converter (#896)
* add lsvt

* fix name

* fix name

* update

* add lsvt

* set default val 0

* fix a bug

* fix typos

* fix file name

* fix lint

* fix lint
2022-04-18 09:15:42 +08:00
Y-M-Y 3179e4d6bd
[Feature] Add analyze_logs in tools and its description in docs (#899)
* Create analyze_logs.py

* Update tools.md

* fix lint and typo

* Update analyze_logs.py

* Add arg table and demo log file

* Delete line66 for lint error

* fix captial letters

* update doc

* fix markdown indentation

* Add log_analysis_demo.png to demo/resources

* Add log_analysis_demo.png and two links in table

* Improve epoch-based metric

* fix lint error

* fix lint error(tabs and spaces)

* check code lints and format

Co-authored-by: Mountchicken <mountchicken@outlook.com>
Co-authored-by: xinke-wang <wangxinyu2017@gmail.com>
2022-04-02 22:40:39 +08:00
Tong Gao 4c57bd35ac
[Docs] Fix the misleading description in test.py (#908)
* [Docs] Fix misleading description in test.py

* update docs
2022-04-02 11:31:48 +08:00
Xinyu Wang bea8587f3f
[Feature] Add ReCTS Data Converter (#892) 2022-03-30 15:24:37 +08:00
Xinyu Wang 6ef3ecd300
[Feature] Add COCO Text v2 Data Converter (#872) 2022-03-30 15:22:53 +08:00
Xinyu Wang ec7b8420bf
[Feature] Add MTWI Data Converter (#867) 2022-03-30 15:18:04 +08:00
Qing Jiang 4ab411e84c
[Feature] Add Vintext Converter (#864) 2022-03-30 15:16:04 +08:00
Qing Jiang a682ca5dfd
[Feature] Add BID Converter (#862)
* newdataset

* d

* add docs

* fix bugs and docs

* fix bugs

* fix docs and add annotation format in load_txt_file

* fix funsd

* change _ to -

* update doc and and add ignores to store verticle instances

* update doc

* using crops instead of dst_imgs

* replace test with val

* fix docstring

* fix doc

* update doc

* fix padding size

* update doc

* update doc

* update tree structure

* add - before after

* add optional

* add tab before bash

* set val-ratio to 0.

* fix docstring

* fix lint

* revert docs

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2022-03-30 15:14:44 +08:00
Xinyu Wang 7a8cf99524
[Feature] Add IC13 (Focused Scene Text) Data Converter (#861)
* add ic13 data converter

* fix extension

* add docs

* fix doc

* fix doc

* update docs

* move directory tree

* fix indentation

* revert docs

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2022-03-30 15:13:29 +08:00
Xinyu Wang 692425e79d
[Feature] Add IC11 (Born-digital Images) Data Converter (#857)
* add IC11 (born-digital images) converter

* fix

* fix format

* add docs; fix format;

* fix doc

* doc string

* fix docs

* move directory tree

* fix indentation

* revert docs

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2022-03-30 15:12:40 +08:00
Xinyu Wang 347a8090e2
[Feature] Add KAIST Converter (#835)
* add KAIST converter

* support jsonl; save filtered imgs to ignores

* add docs

* fix doc; add annotation format docstring; fix jsonl ascii

* fix docstring

* update doc for preserve vertical

* fix doc

* move directory tree

* move directory tree

* fix indentation

* set default val to 0

* im -> img

* fix det val default rate

* revert docs

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2022-03-30 15:11:04 +08:00
Qing Jiang e780563ed7
[Feature] Add ILST Converter (#833)
* [Feature] Add ILST Converter

* [fix] typo

* add docs and remove latin

* add docs and remove latin

* fix bug

* fix bugs and docs

* fix bugs

* add annotation format in load_xml_file and change test_ratio to val_ratio

* bug fix

* fix docstring

* chane _ to -

* add ignores to store filtered vertical instances

* update doc

* update doc

* using crops instead of dst_imgs

* fix typos and remove test with val

* fix docstring

* update doc

* fix padding size

* update doc

* simplify bash

* update doc

* update doc

* remove tree

* update tree structure

* add - before after

* add optional

* add tab before bash

* set val-ratio to 0.

* Update docs/en/datasets/det.md

* fix lint

* fix lint

* revert docs

Co-authored-by: Tong Gao <gaotongxiao@gmail.com>
2022-03-30 15:09:39 +08:00
Xinyu Wang b68afca2d4
[Feature] Add IMGUR Converter (#825)
* add IMGUR converter

* fix typo

* support jsonl; update docs

* fix recog doc overview

* move directory tree

* fix indentation

* revert docs

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2022-03-30 15:07:55 +08:00
Xinyu Wang ee2c3cfd46
[Feature] Add DeText Converter (#818)
* add DeText Converter

* Update tools/data/textrecog/detext_converter.py

Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* update doc; support jsonl; fix docstrings

* update mkdir func

* fix bug

* update doc; do not filter for test val

* move directory tree

* fix indentation

Co-authored-by: Tong Gao <gaotongxiao@gmail.com>
2022-03-30 14:43:33 +08:00
Xinyu Wang 8b928cb500
[Feature] Add NAF Converter (#815)
* NAF dataset downloading command

* add NAF converter

* revert incorrect url revision

* fix typo

* support jsonl; save filtered crops; add data description in docstring; update ddoc

* remove preserve-symbol; update docs; fix special symbol filter

* move tree structure

* fix indentation

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2022-03-30 14:31:47 +08:00