Commit Graph

98 Commits (e8d69cf2ff8a3a40fdb548872a044e1253a9987b)

Author SHA1 Message Date
Ezra-Yu d8f556668e Refactor vis scheduler tool 2022-07-18 11:11:13 +08:00
mzr1996 5a3e736b4e [Feature] Implement offline evaluation. 2022-07-18 11:11:13 +08:00
Ezra-Yu a82de04b67 Enhance browse datset 2022-07-18 11:11:13 +08:00
mzr1996 ee6e585e41 Mazerun/base classifier 2022-07-18 11:11:13 +08:00
mzr1996 522ab1fd84 [Feature] Add Visualization hook 2022-07-18 11:11:04 +08:00
Ezra-Yu 4d4b22377d Add browse dataset 2022-07-18 10:53:56 +08:00
mzr1996 efaa93aae1 [Refactor] Refactor entry scripts `train.py` and `test.py`. 2022-07-18 10:53:56 +08:00
mzr1996 0537c4d70c [Feature] Add `ClsVisualizer`. 2022-07-18 10:53:27 +08:00
yingfhu de002e455f [Refactor] Use `MMLogger` from MMEngine in `get_logger` and `print_log`. 2022-07-18 10:53:27 +08:00
mzr1996 877ea3080a [Fix] Fix wrong `--local_rank`. 2022-05-17 21:10:25 +08:00
Hu Di b4eefe4794
[Enhance] Support training on IPU and add fine-tuning configs of ViT. (#723)
* implement training and evaluation on IPU

* fp16 SOTA

* Tput reaches 5600

* 123

* add poptorch dataloder

* change ipu_replicas to ipu-replicas

* add noqa to config long line(website)

* remove ipu dataloder test code

* del one blank line in test_builder

* refine the dataloder initialization

* fix a typo

* refine args for dataloder

* remove an annoted line

* process one more conflict

* adjust code structure in mmcv.ipu

* adjust ipu code structure in mmcv

* IPUDataloader to IPUDataLoader

* align with mmcv

* adjust according to mmcv

* mmcv code structre fixed

Co-authored-by: hudi <dihu@graphcore.ai>
2022-04-29 22:22:19 +08:00
takuoko df6edd7f5a
[Feature] Support VAN. (#739)
* add van

* fix config

* add metafile

* add test

* model convert script

* fix review

* fix lint

* fix the configs and improve docs

* rm debug lines

* add VAN into api

Co-authored-by: Yu Zhaohui <1105212286@qq.com>
2022-04-28 09:35:17 +08:00
Ma Zerun 02c8f82147
[Enhance] Add extra dataloader settings in configs. (#752)
* Use `train_dataloader`, `val_dataloader` and `test_dataloader` settings
in the `data` field to specify different arguments.

* Fix bug

* Fix bug
2022-04-01 15:57:12 +08:00
Ezra-Yu 922a31a68e
[Feature] ADD RepMLP Backbone and checkpoints. (#709)
* add repmlp

* refactor backbone code

* add checkpoint, readme, unit tests

* unchange demo

* improve docstring.

* update pic

* refactor patch embed

* refactor unit tests

* fix lint

* update tools

* update tools

* Update checkpoint path

Co-authored-by: mzr1996 <mzr1996@163.com>
2022-03-30 20:40:25 +08:00
Ma Zerun a87ff7e153
[Enhance] Use `--a-b` instead of `--a_b` in arguments. (#754) 2022-03-30 19:16:28 +08:00
Hubert 995f2912ab
[Feature] Add diff seeds to diff ranks. (#744)
* [Feature] Add diff seeds to diff ranks.

* lint
2022-03-25 15:31:13 +08:00
Ezra-Yu 3482521587
[Feature] Add multi machine dist_train (#734)
* add dist_train with multi machines

* add dist_train with multi machines
2022-03-23 12:03:03 +08:00
Ezra-Yu d08c2a148a
[Enhance] Enhance vis-pipeline tool. (#604)
* enhance vis-pipeline add intermediate imgs

* enhance vis-pipeline add intermediate imgs

* improve code of vi-pipeline

* modify docs for vis-pipeline

* Use `mmcv.utils.digit_version` instead of `distutils`

* add size info in the bottom

* preform adaptive-resize in before concat

* add warning info

* fix docs

* fix lint

* fix comment

* fix docs

Co-authored-by: mzr1996 <mzr1996@163.com>
2022-03-04 14:40:02 +08:00
kusakana 779a06257c
[Feature] Support Wide-ResNet. (#715)
* Add configs of Wide ResNet

* updated config

* add docs and metafile

* update configs

* remove extra import

* Update metafile and readme

Co-authored-by: Ezra-Yu <1105212286@qq.com>
Co-authored-by: mzr1996 <mzr1996@163.com>
2022-03-04 14:06:34 +08:00
Ezra-Yu 24ae53a4a0
[Enhance] Return code 1 if scripts runs failed. (#694)
* return code 1 when run failed

* return code 1 when run failed
2022-03-03 10:54:16 +08:00
Ma Zerun 1a28f9ace6
[Feature] Add `evaluate` function for ConcatDataset. (#650)
* Add `evaluate` function for ConcatDataset

* Remove newline in log.

* Fix lint

* Specify mmcv version in Windows CI
2022-02-28 12:46:17 +08:00
Ma Zerun 1b5712a551
[Enhance] Add a new pre-commit-hook to automatically add a copyright. (#710) 2022-02-25 11:48:07 +08:00
RunningLeon 9ee41577d0
[Enhance] Add deprecation message for deploy tools. (#697)
* add derepcation message for deploy tools

* add space

* Update tools/deployment/onnx2tensorrt.py

Co-authored-by: Ma Zerun <mzr1996@163.com>

* remove colorama package

* use plaintext to avoid import mmcv

Co-authored-by: Ma Zerun <mzr1996@163.com>
2022-02-23 22:24:44 +08:00
Ezra-Yu 7fcaedcbfb
[Feature] Add ResNetV1c. (#692)
* add ResNetV1c

* add unit tests

* fix lint

* update docstring

* fix lint
2022-02-23 11:36:33 +08:00
Ma Zerun fcd57913ae
[Enhance] Upgrade isort pre-commit hooks. (#687)
* Use new version flake8 and isort hooks

* Fix missing copyright
2022-02-17 02:17:20 +08:00
Ma Zerun 44e9902979
[Refactor] Use `--gpu-id` instead of `--gpu-ids` in non-distributed multi-gpu training/testing. (#688) 2022-02-17 02:17:01 +08:00
Ma Zerun bca695b684
[Refactor] Remove deprecation. (#633)
* Remove deprecated `--options` in some tools

* Remove deprecated eval hooks and fp16 hooks

* Remove deprecated mixup&cutmix, pretrained and return_tuple arguments.

* Remove deprecated `deprecated_options` in multi label dataset

* Remove deprecated `formating.py`

* Remove deprecated default mode of `LabelSmoothLoss`

* Revert pretrained argument, and remove it's deprecation sign.

* Update unit test
2022-02-10 09:30:18 +08:00
mzr1996 e0edffb353 Merge branch 'dev' 2022-01-31 12:00:17 +08:00
Ma Zerun 8ef5aeda40
[Enhance] New-style CPU training and inference. (#674)
* [Enhance] New-style CPU training and inference.

* Add version check in CPU training/test
2022-01-30 20:49:54 +08:00
Ezra-Yu 94eb3ff83e
[Feature] Add Twins backbone and convert checkpoints. (#642)
* add twins backbone

* add position_encoding

* refactor twins

* Supplemental unit tests

* update docstring and readme

* update docstring and readme

* update docstring and readme

* update docstring

* update docstring

* update docstring

* update docstring

* remove note

* update doc and docstring

* update docstring

* update docstring

* use abstract pdf link and rename yamlfile

* Update model link

Co-authored-by: mzr1996 <mzr1996@163.com>
2022-01-27 10:25:05 +08:00
Ma Zerun f552419e45
[Enhance] Add setup multi-processing both in train and test. (#671) 2022-01-27 10:18:36 +08:00
Zhicheng Chen d56170a734
[Feature] Support EfficientNet (#649)
* add config for resnest test

* fix config

* add label smoothing

* add memcached

* minor fix

* fix bug

* fix config

* add config

* minor fix

* fix configs

* use EResize

* change interpolation

* add more configs

* add docsting

* add unittest

* remove unnecessary changes

* minor fix

* add more docstring

* fix linting

* add efficient backbone

* add config

* add Edge Residual

* fix bug

* remove unnecessary files

* refactor

* add resize in crop to ensure crop size is output size

* fix bug and add comments

* test

* fix

* add more configs

* add more configs

* add more configs

* fix bug

* add model zoo

* fix

* reorganize code

* add edge tpu

* add edge tpu converter

* rename

* update readme

* reorganize code and config

* Rename configs of EfficientNet, and add metafile & model_zoo

* Remove `backend='pillow'`

* Add comments about EfficientNet-EdgeTPU

* Rename the convert tool of EfficientNet.

* Refactor EfficientNet and update docstring.

* Update EfficientNet-EdgeTPU config

* Fix unit tests

Co-authored-by: lixinran <lixr423@outlook.com>
Co-authored-by: lixinran <lixinran@sensetime.com>
Co-authored-by: mzr1996 <mzr1996@163.com>
2022-01-25 12:14:17 +08:00
xiefeifeihu 1a91a7fed5
[Fix] Fix API changes in `pytorch-grad-cam>=1.3.7` (#656)
* Update vis_cam.py

Fix bug 654 temporary

* support grad-cam==1.3.7

Co-authored-by: Ezra-Yu <1105212286@qq.com>
2022-01-19 19:00:31 +08:00
xiefeifeihu d73eb01cba
[Fix] Fix bug which breaks `cal_train_time` in `analyze_logs.py`. (#662)
* fix bug mmclassification issues 661

https://github.com/open-mmlab/mmclassification/issues/661

* fix lint

Co-authored-by: Zhicheng Chen <chen1319276472@foxmail.com>
2022-01-19 18:38:48 +08:00
Ma Zerun b39885d953
[Feature] Support K-fold cross-validation (#563)
* Support to use `indices` to specify which samples to evaluate.

* Add KFoldDataset wrapper

* Rename 'K' to 'num_splits' accroding to sklearn

* Add `kfold-cross-valid.py`

* Add unit tests

* Add help doc and docstring
2022-01-19 18:32:55 +08:00
mzr1996 321ad09e6d Merge remote-tracking branch 'origin/master' into dev 2022-01-13 19:27:23 +08:00
Rejnald Lleshi c07f8326e3
[Feature] Add conversion script from pytroch to mlmodel (#597) 2022-01-13 12:32:52 +08:00
imyhxy 32d606e1a1
[Refactor] Save class names in best checkpoint created by evaluation hook (#641)
* Save class names in best checkpoint created by evaluation hook

* Save meta info into runner instaed of checkpoint_config
2022-01-13 12:20:59 +08:00
Ezra-Yu 131d8c6296
[Feature] Add CAM visualization tool (#577)
* add cam-grad tool

* refactor cam-grad tool

* add docs

* update docs

* Update docs and support Transformer

* remove pictures and use link

* replace example img and finish EN docs

* improve docs

* improve code

* Fix MobileNet V3 configs

* Refactor to support more powerful feature extraction.

* Add unit tests

* Fix unit test

* fix distortion of visualization exapmles in docs

* fix distortion

* fix distortion

* fix distortion

* merge master

* merge fix conficts

* Imporve the tool

* Support use both attribute name and index to get layer

* add default get_target-layers

* add default get_target-layers

* update docs

* update docs

* add additional printt info when not using target-layers

* Imporve docs

* Fix enumerate list.

Co-authored-by: mzr1996 <mzr1996@163.com>
2021-12-23 18:53:40 +08:00
Ma Zerun 894a82ea4f
[Refactor] Change `load_json_logs` to `load_json_log`. (#602) 2021-12-14 18:03:27 +08:00
Ezra-Yu fdb178303b
[Docs] Add analysis&misc docs (#525)
* refactor ananlysis_log and add docs

* refactor ananlysis_log and fix lint

* improve docs

* improve docs

* improve docs

* fix bugs and refactor analysis_log

* rename analysis folder to analysis_tools

* fix failure link

* add result analysis docs

* add eval-metrics docs

* add misc doc

* fix lint

* improve docs

* improve misc docs

* fix docs

* Change the `eval_options` in `tools/analysis_tools/eval_metric.py` to
`metric_options`

* Improve tutorials

Co-authored-by: mzr1996 <mzr1996@163.com>
2021-12-07 11:27:34 +08:00
Ezra-Yu 7b37bc5bf5
[Refactor] Refactor `analysis_log.py`. (#529)
* fix bugs and refactor analysis_log

* update some names
2021-12-03 16:02:50 +08:00
Ma Zerun d25a78d547
[Enchance] Set a random seed when the user does not set a seed. (#554) 2021-12-02 18:09:55 +08:00
Ma Zerun 78d6d8503f
[Refactor] Use new API of matplotlib to handle blocking input in visualization. (#568)
* [Refactor] Use new API of matplotlib to handle blocking input in
visualization.

* Modify unit tests
2021-12-02 17:46:40 +08:00
Zhicheng Chen fc8adbc149
[Enhance] Add metafile, readme and converted models for MLP-Mixer (#539)
* add pth converter

* minor update on config files, add metafile and readme

* add missing readme and minor fixes

* minor fixes

* Update config names and checkpoint download link

* Update model_zoo.md

Co-authored-by: mzr1996 <mzr1996@163.com>
2021-11-24 19:04:19 +08:00
Ma Zerun a55324c453
[Refactor] Remove useless `import_modules_from_string`. (#544) 2021-11-22 14:01:26 +08:00
imyhxy dc35eb62b6
[Fix] Fix an error on indexing scalar metrics in `analyze_result.py` (#518)
* [Fix] Error on indexing scalar metrics

* [Fix] Error on indexing scalar metrics

Co-authored-by: Ma Zerun <mzr1996@163.com>

Co-authored-by: Ma Zerun <mzr1996@163.com>
2021-11-05 11:57:49 +08:00
imyhxy abb5a222cf
[Fix] Fix wrong condition judgment in `analyze_logs.py` and prevent empty curve. (#510)
* [Fix] Analyze logs with single training iteration

* [Fix] Make `plot_curve` with 'accuracy' metric

* [Fix] Assert length of training log records of each epoch is larger than 1

Co-authored-by: Ma Zerun <mzr1996@163.com>

Co-authored-by: Ma Zerun <mzr1996@163.com>
2021-11-03 11:37:51 +08:00
Ezra-Yu b486bb23f8
[Feature] Add a tool to visualize learning rate in each iterations (#498)
* add vis lr

* add doc

* Update doc and rm load_json_log in analysis

* Update docs

* add unit tests and update docstring

* fix unit-tests

* Use DummyIterBasedRunner and DummyEpochBasedRunner to simulate training
process.

* rm function val and add judge

* update docs

* improve english expression

* Update docs/tools/visualization.md

Co-authored-by: Ma Zerun <mzr1996@163.com>

* fix typo and ImageNet datasize

* fix typo

* update example

Co-authored-by: mzr1996 <mzr1996@163.com>
2021-11-03 10:48:56 +08:00
Ezra-Yu 52e62560d4
[Feature] Add a tool to find broken files. (#482)
* add verify dataset

* add phase

* rm attr of single_process

* Use `mmcv.track_parallel_progress` to track the validation.

Co-authored-by: mzr1996 <mzr1996@163.com>
2021-10-27 10:14:19 +08:00