Commit Graph

91 Commits (20c7dc689c47af4b3f33d91114c3b83933442319)

Author SHA1 Message Date
Miao Zheng 20c7dc689c
[Feature] Add BioMedical data loading (#2176)
* [WIP] Add BioMedical data loading

* add depends nibabel

* fix bug

* fix ut

* fix

* add test data

* xyz2zyx zyx2xyz

* format

* remove ignore empty

* remove ignore empty

* remove with seg in LoadBiomedicalAnnotation

* float32

* docstring

* toxyz

* docstring
2022-10-18 16:30:08 +08:00
MengzhangLI f3cd44bebf
[Fix] Fix ResizeToMultiple transform in MMSeg 1.x (#2185) 2022-10-14 15:37:35 +08:00
Miao Zheng 8de0050f25
[Refactor] data flow (#1956)
* [WIP] Refactor data flow

* model return

* [WIP] Refactor data flow

* support data_samples is optional

* fix benchmark

* fix base

* minors

* rebase

* fix api

* ut

* fix api inference

* comments

* docstring

* docstring

* docstring

* fix bug of slide inference

* add assert c > 1
2022-08-26 15:54:23 +08:00
Miao Zheng 50546da85c
[Fix]Remove modules from mmcv.runner and mmcv.utils (#1966)
* [WIP] mmcv-clean

* [WIP]Remove modules from mmcv.runner and mmcv.utils

* wip

* fix import mmengine

* remove ut

* loadcheckpoint in mae
2022-08-25 15:15:21 +08:00
谢昕辰 3d98c25052 fix base dataset (#1926) 2022-08-19 20:50:03 +08:00
Miao Zheng e0499d5a77 [Fix] Fix repo based on refactoring standard (#1869)
* [Fix] Fix repo based on refactory standard

* fix ut
2022-08-19 20:50:02 +08:00
谢昕辰 167f94a70b rename data to structures (#1854) 2022-08-19 20:50:02 +08:00
MengzhangLI ecab73a892 [Feature] Add P1 DataTransform (#1843)
* [Feature] Add P1 DataTransform

* fix unit test error

* fix @cache_randomness location
2022-08-19 20:50:01 +08:00
MengzhangLI e4b9d72a11
[Fix] 2.0 Fix mDice metric for medical datasets (#1864) 2022-08-04 18:32:52 +08:00
MengzhangLI 3cf2bbda2a
[Fix] Change CustomDataset to BaseSegDataset (#1791) 2022-07-26 12:01:40 +08:00
谢昕辰 ba4d1d62aa
[Feature] Add LoadImageFromNdArray pipeline (#1810)
* add load image from ndarray pipeline

* fix import
2022-07-22 19:40:00 +08:00
Miao Zheng 4de57b49c5
[Fix] Fix register_all_modules and imports (#1793)
* [Fix] Fix register_all_modules and imports

* fix transforms import
2022-07-21 22:44:42 +08:00
zhengmiao 4b76f277a6 [Refactory] MMSegmentation Content 2022-07-15 15:47:29 +00:00
xiexinchen.vendor d74dc89214 [Refactor] Fix load annotations by file 2022-07-11 11:31:38 +00:00
xiexinch 761e1a9983 minor change 2022-07-05 20:43:33 +08:00
zhengmiao 89d6f89dfc Merge branch 'linfangjian/refactor_citysmetric' into 'refactor_dev'
[Refactor] Refactor cityscapes metrics

See merge request openmmlab-enterprise/openmmlab-ce/mmsegmentation!46
2022-06-28 03:21:33 +00:00
linfangjian.vendor 6053345b3d [Refactor] Refactor cityscapes metrics 2022-06-28 03:21:33 +00:00
limengzhang.vendor f2bac79f03 [Refactor] Refactor DatasetWrapper 2022-06-27 14:36:18 +00:00
zhengmiao b23982d1b3 [Refactory] Refactory BaseSegmentor based BaseModel 2022-06-19 06:32:09 +00:00
MengzhangLI 7a78d6e483 [Fix] Fix METAINFO typo in ChaseDB1Dataset 2022-06-09 20:49:32 +08:00
zhengmiao f59ef99b00 [Fix]Add label_map and reduce_zero_label in metainfo of dataset and deprecate reduce_zero_label in load annotation 2022-06-09 12:23:36 +00:00
MengzhangLI c061d6d30e [Fix] Fix omitting to_tensor in PackSegInputs 2022-06-09 11:01:56 +08:00
limengzhang.vendor 5b9c29f992 [Refactor] Refactor Dataset and its Transform Config files 2022-05-31 14:28:42 +00:00
MeowZheng fcb948295c [Enhancement] Revise RandomCrop 2022-05-27 21:52:49 +08:00
zhengmiao 1af338e496 [Refactory] Dataset refactory 2022-05-26 09:13:40 +00:00
limengzhang.vendor baaf9a4742 [Refactor] Add PackSegInputs and some Transforms 2022-05-26 03:06:02 +00:00
linfangjian.vendor f6d3291064 [Refactor] Refactor RandomCrop and PhotoMetricDistortion 2022-05-25 01:58:37 +00:00
linfangjian.vendor 7a32d610e4 [Refactor] Refactor all registries 2022-05-10 12:15:20 +00:00
panfeng-hover add835be3f Avoid converting label ids twice by label map during evaluation (#1417)
* Avoid converting label ids twice by label map during evaluation

* Update mmseg/datasets/custom.py

Co-authored-by: Miao Zheng <76149310+MeowZheng@users.noreply.github.com>

* lint

Co-authored-by: Miao Zheng <76149310+MeowZheng@users.noreply.github.com>
Co-authored-by: MeowZheng <meowzheng@outlook.com>
2022-04-12 18:26:25 +08:00
Yzichen f45ddc97bb fix bug about label_map (#1445)
* fix bug about label_map

* Update mmseg/datasets/pipelines/loading.py

Co-authored-by: MengzhangLI <mcmong@pku.edu.cn>

* lint

Co-authored-by: MengzhangLI <mcmong@pku.edu.cn>
Co-authored-by: MeowZheng <meowzheng@outlook.com>
2022-04-09 21:11:47 +08:00
Miao Zheng fa316a1f85 [Feature] Support dataset initialization with file_client (#1402)
* [Feature] Support file_client in dataset initialization

* docstring

* revise osp.exist
2022-03-28 23:53:23 +08:00
MengzhangLI f15a21a30d [Enchance] Support random seed for distributed sampler (#1411)
* support random seed for distributed sampler

* move mmseg/utils/dist_util.py to mmseg/core/utils/dist_util.py

* move mmseg/utils/dist_util.py to mmseg/core/utils/dist_util.py

* change dist sampler

* change dist sampler

* fix docstring in sync_random_seed
2022-03-28 23:50:39 +08:00
Rockey da6bb2c8c5 [Feature]: Add diff seeds to diff ranks and set torch seed in worker_init_fn (#1362) 2022-03-10 09:41:16 +08:00
FangjianLin 38df41ea19 [Feature] Add `min_size` arg in `Resize` to keep the shape after resize bigger than slide window (#1318)
* [Feature] add setr_resize

* fix a bug

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix
2022-03-01 16:25:48 +08:00
Miao Zheng b97cfa77d2 [Enhancement] Revise pre-commit-hooks (#1315) 2022-02-23 23:44:27 +08:00
Waterman0524 a93423e1fd [Feature] Support iSAID aerial dataset. (#1115)
* support iSAID aerial dataset

* Update and rename docs/dataset_prepare.md to 博士/dataset_prepare.md

* Update dataset_prepare.md

* fix typo

* fix typo

* fix typo

* remove imgviz

* fix wrong order in annotation name

* upload models&logs

* upload models&logs

* add load_annotations

* fix unittest coverage

* fix unittest coverage

* fix correct crop size in config

* fix iSAID unit test

* fix iSAID unit test

* fix typos

* fix wrong crop size in readme

* use smaller figure as test data

* add smaller dataset in test data

* add blank in docs

* use 0 bytes pseudo data

* add footnote and comments for crop size

* change iSAID to isaid and add default value in it

* change iSAID to isaid in _base_

Co-authored-by: MengzhangLI <mcmong@pku.edu.cn>
2022-02-17 19:07:32 +08:00
MengzhangLI 1abf76decf [Fix] Fix wrong palette value in vaihingen (#1292) 2022-02-16 22:41:39 +08:00
MengzhangLI d4f5bb25fc [Enhancement] Upgrade isort in pre-commit hook (#1270) 2022-02-08 19:06:33 +08:00
MengzhangLI fe42371297 [Feature] Support ISPRS Vaihingen Dataset. (#1171)
* Add Vaihingen

* upload models&logs of vaihingen

* fix unit test

* fix dataset pipeline

* fix unit test coverage

* fix vaihingen docstring
2022-01-22 20:27:51 +08:00
Kingdrone 634fbceab0 [Feature] Support ISPRS Potsdam Dataset. (#1097)
* add isprs potsdam dataset

* add isprs dataset configs

* fix lint error

* fix potsdam conversion bug

* fix error in potsdam class

* fix error in potsdam class

* add vaihingen dataset

* add vaihingen dataset

* add vaihingen dataset

* fix some description errors.

* fix some description errors.

* fix some description errors.

* upload models & logs of Potsdam

* remove vaihingen and add unit test

* add chinese readme

* add pseudodataset

* use mmcv and add class_names

* use f-string

* add new dataset unittest

* add docstring and remove global variables args

* fix metafile error in PSPNet

* fix pretrained value

* Add dataset info

* fix typo

Co-authored-by: MengzhangLI <mcmong@pku.edu.cn>
2022-01-18 14:15:15 +08:00
Kyungmin Lee 88944e9935 [Feature] Add MultiImageMixDataset (#1105)
* Fix typo in usage example

* original MultiImageMixDataset code in mmdet

* Add MultiImageMixDataset unittests in test_dataset_wrapper

* fix lint error

* fix value name ann_file to ann_dir

* modify retrieve_data_cfg (#1)

* remove dynamic_scale & add palette

* modify retrieve_data_cfg method

* modify retrieve_data_cfg func

* fix error

* improve the unittests coverage

* fix unittests error

* Dataset (#2)

* add cfg-options

* Add unittest in test_build_dataset

* add blank line

* add blank line

* add a blank line

Co-authored-by: Miao Zheng <76149310+MeowZheng@users.noreply.github.com>

Co-authored-by: Younghoon-Lee <72462227+Younghoon-Lee@users.noreply.github.com>
Co-authored-by: MeowZheng <meowzheng@outlook.com>
Co-authored-by: Miao Zheng <76149310+MeowZheng@users.noreply.github.com>
2022-01-11 16:18:24 +08:00
Kyungmin Lee e9dd32b6e8 [Feature] Add Mosaic transform (#1093)
* Fix typo in usage example

* original mosaic code in mmdet

* Adjust mosaic to the semantic segmentation

* Remove bbox test in test_mosaic

* Add unittests

* Fix resize mode for seg_fields

* Fix repr error

* modify Mosaic docs

* modify from Mosaic to RandomMosaic

* Add docstring

* modify Mosaic docstring

* [Docs] Add a blank line before Returns:

* add blank lines

Co-authored-by: MeowZheng <meowzheng@outlook.com>
2022-01-11 16:17:36 +08:00
jbwang1997 44d4c3877e [Fix] Set random seed for generating `palette` if not given. (#1152)
* Fix colors

* fix comments

* Add comments

* Add comments. Add random seed in datasets
2021-12-23 09:51:50 +08:00
MengzhangLI 4a90241f91 [Docs] Refactor the structure of documentation (#1128)
* merge docs/ and docs_zh-CN/

* merge docs/ and docs_zh-CN/

* merge docs/ and docs_zh-CN/

* merge docs/ and docs_zh-CN/

* fix launch utility url

* fix launch utility url

* fix wrong pytorch doc url

* remove wrong links docs//
2021-12-16 18:56:45 +08:00
Kyungmin Lee 40b9ebb565 [Feature] Add Cutout transform (#1022)
* Fix typo in usage example

* [Feature] Add CutOut transform

* CutOut repr covered by unittests

* Cutout ignore index, test

* ignore_index -> seg_fill_in, defualt is None

* seg_fill_in is added to repr

* test is modified for seg_fill_in is None

* seg_fill_in (int), 0-255

* add seg_fill_in test

* doc string for seg_fill_in

* rename CutOut to RandomCutOut, add prob

* Add unittest when cutout is False
2021-11-30 20:37:06 +08:00
Kingdrone 48d4222412 [Feature] Support LoveDA dataset (#1028)
* update LoveDA dataset api

* revised lint errors in dataset_prepare.md

* revised lint errors in loveda.py

* revised lint errors in loveda.py

* revised lint errors in dataset_prepare.md

* revised lint errors in dataset_prepare.md

* checked with isort and yapf

* checked with isort and yapf

* checked with isort and yapf

* Revert "checked with isort and yapf"

This reverts commit 686a51d9

* Revert "checked with isort and yapf"

This reverts commit b877e121bb.

* Revert "revised lint errors in dataset_prepare.md"

This reverts commit 2289e27c

* Revert "checked with isort and yapf"

This reverts commit 159db2f8

* Revert "checked with isort and yapf"

This reverts commit 159db2f8

* add configs & fix bugs

* update new branch

* upload models&logs and add format-only

* change pretraied model path of HRNet

* fix the errors in dataset_prepare.md

* fix the errors in dataset_prepare.md and configs in loveda.py

* change the description in docs_zh-CN/dataset_prepare.md

* use init_cfg

* fix test converage

* adding pseudo loveda dataset

* adding pseudo loveda dataset

* adding pseudo loveda dataset

* adding pseudo loveda dataset

* adding pseudo loveda dataset

* adding pseudo loveda dataset

* Update docs/dataset_prepare.md

Co-authored-by: Junjun2016 <hejunjun@sjtu.edu.cn>

* Update docs_zh-CN/dataset_prepare.md

Co-authored-by: Junjun2016 <hejunjun@sjtu.edu.cn>

* Update docs_zh-CN/dataset_prepare.md

Co-authored-by: Junjun2016 <hejunjun@sjtu.edu.cn>

* Delete unused lines of unittest and Add docs

* add convert .py file

* add downloading links from zenodo

* move place of LoveDA and Cityscapes in doc

* move place of LoveDA and Cityscapes in doc

Co-authored-by: MengzhangLI <mcmong@pku.edu.cn>
Co-authored-by: Junjun2016 <hejunjun@sjtu.edu.cn>
2021-11-24 19:41:19 +08:00
Junjun2016 67f1420472 [Enhancement] Add codespell pre-commit hook and fix typos (#920)
* add codespell pre-commit hook and fix typos

* Update mmseg/models/decode_heads/dpt_head.py

* Update mmseg/models/backbones/vit.py

* Update mmseg/models/backbones/vit.py

* fix typos

* skip formating typo

* deprecate formating

* skip ipynb

* unstage ipynb changes

* unstage ipynb changes

* fix typos in ipynb

* unstage ipynb changes
2021-10-13 06:21:17 -07:00
Shouping Shan adb1cd361b [Fix] Fix bug when loading class name form file in custom dataset (#923)
* [Fix] #916 expection string type classes

* add unittests for string path classes

* fix double quote string in test_dataset.py

* move the import to the top of the file

* fix isort lint error

fix isort lint error when move the import to the top of the file
2021-10-08 01:06:18 +08:00
DerrickWang005 bf1bdba623 support coco stuff-10k/164k (#625)
* support coco stuff-10k/164k

* update docs

* fix docs

* update docs

* fix import lints

* Update docs/dataset_prepare.md

* Update docs/dataset_prepare.md

* Update tools/convert_datasets/coco_stuff164k.py

* Update tools/convert_datasets/coco_stuff10k.py

* Update tools/convert_datasets/coco_stuff10k.py

* Update tools/convert_datasets/coco_stuff10k.py

* Update tools/convert_datasets/coco_stuff10k.py

* Update coco_stuff.py

fix the description of the dataset

* Update dataset_prepare.md

fix the doc tree of coco stuff 10k

* Update coco_stuff10k.py

fix img_dir

* Update coco_stuff.py

fix descriptions

* Update coco_stuff164k.py

fix out_dir

* Update coco_stuff10k.py

fix save file name

* Update coco_stuff.py

fix seg_map_suffix

* Update dataset_prepare.md

fix -p

* Update dataset_prepare.md

fix doc tree

* modify coco stuff convertor

* Remove redundant code

* fix 164k convert bug

* remove redundant comment

* add deeplabv3 configs and more iterations

* replace shutil.move with shtil.copyfile

* Update deeplabv3_r50-d8_512x512_4x4_80k_coco_stuff10k.py

fix wrong config

* Update deeplabv3_r101-d8_512x512_4x4_80k_coco_stuff164k.py

fix wrong config

* fix wrong configs

* fix wrong configs

* fix wrong path for coco stuff 10k

* fix convert bugs

* fix seg_filename bug

* when nproc=0, use track progress

* rename configs: coco_stuff --> coco-stuff

* add coco-stuff 10k and 164k to README.md

* update configs

* add deeplabv3 benchmark

* add pspnet benchmark

* remove redundant comma

Co-authored-by: Junjun2016 <hejunjun@sjtu.edu.cn>
2021-09-22 20:48:08 +08:00
uni19 4583dc1033 [Enhancement] Support loading GT for evaluation from multi-file backend (#867)
* support load gt for evaluation from multi-backend

* move some code from get_gt_seg_maps to get_one_gt_seg_map

* rename gt_seg_map_loader_conf to gt_seg_map_loader_cfg

* fix doc str

* rename get_one_gt_seg_map to get_gt_seg_map_by_idx
2021-09-14 19:16:01 -07:00