Commit Graph

123 Commits (b4ee9d284829b587e4f407818815a94a91b0e269)

Author SHA1 Message Date
takuoko 841256b630
[Feature] Support RetrieverRecall metric & Add ArcFace config (#1316)
* rebase

* add ap metric

* fix mlti-gpu bug in retrevel

* rebase

* rebase

* add training cfgs and update readme.md

* fix bugs(cannot load vecs in dist and diff test-val recall\)

* update configs and readme

* fix ut

* fix doc

* rebase

* fix rebase conflicts

* fix rebase error

* fix UT error

* fix docs

* fix typo

---------

Co-authored-by: Ezra-Yu <18586273+Ezra-Yu@users.noreply.github.com>
2023-02-14 12:46:21 +08:00
zzc98 7e4502b0ac
[Feature] Support InShop Dataset (Image Retrieval). (#1019)
* rebase

* feat: add inshop dataset (retrieval)

* update fileIO

* update unit tests

* fix windows ci

* fix windows ci

* fix lint

* update unit tests

* update docs

* update docs

Co-authored-by: Ezra-Yu <18586273+Ezra-Yu@users.noreply.github.com>
2023-01-18 17:16:54 +08:00
Ma Zerun 97c4ae8805
[Improve] Update registries of mmcls. (#1306)
* [Improve] Update registries of mmcls.

* Update according to comments
2023-01-11 15:20:51 +08:00
Mr.Li 4f5350f365
[Doc] Fix typo. (#1281)
* [Fix] Fix imports in transforms. (#1255)

* fix import

* import from mmegine.utils

* 修复错别字

Co-authored-by: Xieyuan Zhang <25652281+Francis777@users.noreply.github.com>
2022-12-30 15:52:57 +08:00
Colle bac181f393
[Feature] Support Multi-task. (#1229)
* unit test for multi_task_head

* [Feature] MultiTaskHead (#628, #481)

* [Fix] lint for multi_task_head

* [Feature] Add `MultiTaskDataset` to support multi-task training.

* Update MultiTaskClsHead

* Update docs

* [CI] Add test mim CI. (#879)

* [Fix] Remove duplicated wide-resnet metafile.

* [Feature] Support MPS device. (#894)

* [Feature] Support MPS device.

* Add `auto_select_device`

* Add unit tests

* [Fix] Fix Albu crash bug. (#918)

* Fix albu BUG: using albu will cause the label from array(x) to array([x]) and crash the trainning

* Fix common

* Using copy incase potential bug in multi-label tasks

* Improve coding

* Improve code logic

* Add unit test

* Fix typo

* Fix yapf

* Bump version to 0.23.2. (#937)

* [Improve] Use `forward_dummy` to calculate FLOPS. (#953)

* Update README

* [Docs] Fix typo for wrong reference. (#1036)

* [Doc] Fix typo in tutorial 2 (#1043)

* [Docs] Fix a typo in ImageClassifier (#1050)

* add mask to loss

* add another pipeline

* adpat the pipeline if there is no mask

* switch mask and task

* first version of multi data smaple

* fix problem with attribut by getattr

* rm img_label suffix, fix 'LabelData' object has no attribute 'gt_label'

* training  without evaluation

* first version work

* add others metrics

* delete evaluation from dataset

* fix linter

* fix linter

* multi metrics

* first version of test

* change evaluate metric

* Update tests/test_models/test_heads.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update tests/test_models/test_heads.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* add tests

* add test for multidatasample

* create a generic test

* create a generic test

* create a generic test

* change multi data sample

* correct test

* test

* add new test

* add test for dataset

* correct test

* correct test

* correct test

* correct test

* fix : #5

* run yapf

* fix linter

* fix linter

* fix linter

* fix isort

* fix isort

* fix docformmater

* fix docformmater

* fix linter

* fix linter

* fix data sample

* Update mmcls/structures/multi_task_data_sample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/structures/multi_task_data_sample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/structures/multi_task_data_sample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/structures/multi_task_data_sample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/structures/multi_task_data_sample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/structures/multi_task_data_sample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update tests/test_structures/test_datasample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/structures/multi_task_data_sample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update tests/test_structures/test_datasample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update tests/test_structures/test_datasample.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* update data sample

* update head

* update head

* update multi data sample

* fix linter

* fix linter

* fix linter

* fix linter

* fix linter

* fix linter

* update head

* fix problem we don't  set pred or  gt

* fix problem we don't  set pred or  gt

* fix problem we don't  set pred or  gt

* fix linter

* fix : #2

* fix : linter

* update multi head

* fix linter

* fix linter

* update data sample

* update data sample

* fix ; linter

* update test

* test pipeline

* update pipeline

* update test

* update dataset

* update dataset

* fix linter

* fix linter

* update formatting

* add test for multi-task-eval

* update formatting

* fix linter

* update test

* update

* add test

* update metrics

* update metrics

* add doc for functions

* fix linter

* training for multitask 1.x

* fix linter

* run flake8

* run linter

* update test

* add mask in evaluation

* update metric doc

* update metric doc

* Update mmcls/evaluation/metrics/multi_task.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/evaluation/metrics/multi_task.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/evaluation/metrics/multi_task.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/evaluation/metrics/multi_task.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/evaluation/metrics/multi_task.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* Update mmcls/evaluation/metrics/multi_task.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* update metric doc

* update metric doc

* Fix cannot import name MultiTaskDataSample

* fix test_datasets

* fix test_datasets

* fix linter

* add an example of multitask

* change name of configs dataset

* Refactor the multi-task support

* correct test and metric

* add test to multidatasample

* add test to multidatasample

* correct test

* correct metrics and clshead

* Update mmcls/models/heads/cls_head.py

Co-authored-by: Colle <piercus@users.noreply.github.com>

* update cls_head.py documentation

* lint

* lint

* fix: lint

* fix linter

* add eval mask

* fix documentation

* fix: single_label.py back to 1.x

* Update mmcls/models/heads/multi_task_head.py

Co-authored-by: Ma Zerun <mzr1996@163.com>

* Remove multi-task configs.

Co-authored-by: mzr1996 <mzr1996@163.com>
Co-authored-by: HinGwenWoong <peterhuang0323@qq.com>
Co-authored-by: Ming-Hsuan-Tu <alec.tu@acer.com>
Co-authored-by: Lei Lei <18294546+Crescent-Saturn@users.noreply.github.com>
Co-authored-by: WRH <12756472+wangruohui@users.noreply.github.com>
Co-authored-by: marouaneamz <maroineamil99@gmail.com>
Co-authored-by: marouane amzil <53240092+marouaneamz@users.noreply.github.com>
2022-12-30 10:36:00 +08:00
Ma Zerun 940a06f645
[Refactor] Refactor to use new fileio API in MMEngine. (#1176)
* [Refactor] Refactor to use new fileio API in MMEngine.

* Add comment about why use `backend`
2022-11-21 10:56:35 +08:00
Hubert 629f6447ef
[Feature] Migrate CSRA head to 1.x. (#1177)
* [Feat] add csra to 1x

* minor fix

* add voc metrics

* refine

* add unittest

* minor fix

* add more comments

* Fix docs and metafile.

* Fix docs.

Co-authored-by: mzr1996 <mzr1996@163.com>
2022-11-21 10:39:16 +08:00
mzr1996 2153a16dc5 [Docs] Fix some docstrings. 2022-10-10 11:17:48 +08:00
Ma Zerun 61e9d890a6
[CI] Update circle-ci and github workflow. (#1018)
* Add deploy workflow.

* [CI] Update circle-ci and github workflow.

* Fix windows CI

* Update unit tests to save memory
2022-09-13 11:46:15 +08:00
Ma Zerun 85b1eae7f1
Bump to v1.0.0rc0 (#1007)
* Update docs.

* Update requirements.

* Update config readme and docstring.

* Update CONTRIBUTING.md

* Update README

* Update requirements/mminstall.txt

Co-authored-by: Yifei Yang <2744335995@qq.com>

* Update MMEngine docs link and add to readthedocs requirement.

Co-authored-by: Yifei Yang <2744335995@qq.com>
2022-08-31 23:57:51 +08:00
Ezra-Yu e34588a315
[Docs] Refactor API docs. (#958)
* rebase

* update process

* add TODOs in moved classes

* update APIs

* modify the preprocess_cfg to data_preprocessor

* Fix api docs.

Co-authored-by: mzr1996 <mzr1996@163.com>
2022-08-29 15:35:10 +08:00
Ma Zerun 2b88df4484
[Refactor] Refactor the data flow. (#989)
* [Refactor] Refactor the data flow.

* Add comments about data preprocessor.

* Fix after mmengine folder structure refactoring.
2022-08-26 10:40:43 +08:00
Ma Zerun b7d0d521eb
[Refactor] Use `mmengine` instead of `mmcv` and refactor some transforms. (#986)
* [Refactor] Refactor the rest data transforms and fix some docstring.

* Use `mmengine` instead of `mmcv`

* Refactor KFold dataset tools

* Fix docstring according to comments
2022-08-24 15:59:02 +08:00
Ma Zerun b8b31e9343
[Improve] Multiple fixes. (#957)
* Rename some files in unit tests.

* Rename `pipelines` folder to `transforms`.

* Fix version requirement range.

* Remove `init_random_seed` and `set_random_seed`.

* Fix unit tests

* Rename `convert_models` to `model_converters`.
2022-08-09 15:58:08 +08:00
Ma Zerun 43e60ad5a6
[Improve] Rename `mmcls.data` to `mmcls.structures`. (#941) 2022-07-29 14:18:13 +08:00
Ezra-Yu 6ed3860ea6 refactor UTs 2022-07-18 11:11:13 +08:00
Ezra-Yu 0f30c392a3 from core to engine 2022-07-18 11:11:13 +08:00
mzr1996 24bcf069f8 [Refactor] Refactor dev scripts 2022-07-18 11:11:13 +08:00
yingfhu 4fcd7ee072 Add EfficientNetRandomCrop and EfficientNetCenterCrop 2022-07-18 11:11:13 +08:00
mzr1996 12c982f939 [Refactor] Refactor `RepeatAugSampler`. 2022-07-18 11:11:13 +08:00
yingfhu e8d69cf2ff [Fix] adjust default dataset path to empty string 2022-07-18 11:11:13 +08:00
Ezra-Yu 7bca2516f0 Add CUB dataset 2022-07-18 11:11:13 +08:00
Ezra-Yu daa6167336 Add Lighting, ColorJitter and Albumentations 2022-07-18 11:11:13 +08:00
Ezra-Yu a82de04b67 Enhance browse datset 2022-07-18 11:11:13 +08:00
mzr1996 69e5ab065e Change "Default to" to "Defaults to" 2022-07-18 11:11:13 +08:00
mzr1996 dd660ed99e [Improve] Clean useless code and reduce unit tests memory usage. 2022-07-18 11:11:13 +08:00
yingfhu 125b74d4ca [Refactor] Refactor MNIST and FashionMNIST dataset. 2022-07-18 11:11:13 +08:00
Ezra-Yu d6fa480915 [Refactor] Add VOC dataset and mutil_label dataset 2022-07-18 11:11:13 +08:00
yingfhu c78b5597d8 [Refactor] refactor randomCrop, randomResizeCrop and CenterCrop。 2022-07-18 10:57:17 +08:00
mzr1996 05e4c13343 Improve according to comments 2022-07-18 10:53:56 +08:00
mzr1996 c0feadf546 Refactor `RandomErasing` 2022-07-18 10:53:56 +08:00
mzr1996 4f28b9dd63 [Refactor] refactor AutoAugment and RandAugment 2022-07-18 10:53:56 +08:00
mzr1996 3b6d44ea05 [Refactor] Refactor CIFAR10 and CIFAR100 dataset. 2022-07-18 10:53:56 +08:00
mzr1996 995b1d0d58 [Refactor] Add `ResizeEdge` and refactor all dataset configs. 2022-07-18 10:53:56 +08:00
mzr1996 efaa93aae1 [Refactor] Refactor entry scripts `train.py` and `test.py`. 2022-07-18 10:53:56 +08:00
Ezra-Yu 93a27c8324 [Feature] Add `PackClsInputs` and use `LoadImageFromFile`, `Resize` & `RandomFlip` in MMCV. 2022-07-18 10:53:28 +08:00
mzr1996 27e685fe10 [Feature] Add `BaseDataset`, `CustomDataset`, `ImageNet` and `ImageNet21k` 2022-07-18 10:53:27 +08:00
yingfhu de002e455f [Refactor] Use `MMLogger` from MMEngine in `get_logger` and `print_log`. 2022-07-18 10:53:27 +08:00
Ezra-Yu 088d5b5add [Refactor] Inherit all registries from MMEngine and use inherited registries. 2022-07-18 10:53:27 +08:00
mzr1996 1d6fbe0efe [Fix] Fix lint and mmcv version requirement for IPU. 2022-04-29 22:33:29 +08:00
Hu Di b4eefe4794
[Enhance] Support training on IPU and add fine-tuning configs of ViT. (#723)
* implement training and evaluation on IPU

* fp16 SOTA

* Tput reaches 5600

* 123

* add poptorch dataloder

* change ipu_replicas to ipu-replicas

* add noqa to config long line(website)

* remove ipu dataloder test code

* del one blank line in test_builder

* refine the dataloder initialization

* fix a typo

* refine args for dataloder

* remove an annoted line

* process one more conflict

* adjust code structure in mmcv.ipu

* adjust ipu code structure in mmcv

* IPUDataloader to IPUDataLoader

* align with mmcv

* adjust according to mmcv

* mmcv code structre fixed

Co-authored-by: hudi <dihu@graphcore.ai>
2022-04-29 22:22:19 +08:00
Ma Zerun 702c196514
[Docs] Refine API reference. (#774)
* [Docs] Refine API reference

* Add PoolFormer
2022-04-15 20:19:20 +08:00
Ma Zerun d0d6f73fab
[Feature] Add `CustomDataset`. (#738)
* Add custom dataset and refactor ImageNet dataset

* Add default CLASSES for CIFAR dataset

* Add unit tests

* Imporve according to comments
2022-03-30 15:28:26 +08:00
Hubert 995f2912ab
[Feature] Add diff seeds to diff ranks. (#744)
* [Feature] Add diff seeds to diff ranks.

* lint
2022-03-25 15:31:13 +08:00
huyu a19c28fe95
[Enhance] Add `get_cat_ids` and `get_gt_labels` to KFoldDataset. (#721) 2022-03-23 15:57:36 +08:00
Ma Zerun 7856141132
[Enhance] Set torch seed in `worker_init_fn` (#733) 2022-03-16 23:12:57 +08:00
takuoko aa522f4309
[Feature] Support CUB dataset. (#703)
* support cub dataset

* support cub dataset

* fix train lint error

* add docs

* fix class label

Co-authored-by: Ezra-Yu <1105212286@qq.com>

* del debug code

* skip docformatter problem

* add unit tests

* add CUB baseline configs and chpts

* fix some typos

* fix name style

* update flops

Co-authored-by: Ezra-Yu <1105212286@qq.com>
2022-03-16 16:22:28 +08:00
Ma Zerun 1a28f9ace6
[Feature] Add `evaluate` function for ConcatDataset. (#650)
* Add `evaluate` function for ConcatDataset

* Remove newline in log.

* Fix lint

* Specify mmcv version in Windows CI
2022-02-28 12:46:17 +08:00
Ma Zerun fcd57913ae
[Enhance] Upgrade isort pre-commit hooks. (#687)
* Use new version flake8 and isort hooks

* Fix missing copyright
2022-02-17 02:17:20 +08:00
Ma Zerun bca695b684
[Refactor] Remove deprecation. (#633)
* Remove deprecated `--options` in some tools

* Remove deprecated eval hooks and fp16 hooks

* Remove deprecated mixup&cutmix, pretrained and return_tuple arguments.

* Remove deprecated `deprecated_options` in multi label dataset

* Remove deprecated `formating.py`

* Remove deprecated default mode of `LabelSmoothLoss`

* Revert pretrained argument, and remove it's deprecation sign.

* Update unit test
2022-02-10 09:30:18 +08:00