326 Commits

Author SHA1 Message Date
Mashiro
ce7d742407
Fix documentation reference in runner docstring (#668)
* [Fix]Fix error URL in runner docstring

* [Fix]Fix error URL in runner docstring

* clean the code
2022-11-03 15:36:50 +08:00
Mashiro
4e685931d0
Bump version to v0.3.0 (#661)
* Bump version to v0.3.0

* minor refine

* Fix as comment

* Fix as comment

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-11-02 19:34:03 +08:00
Mashiro
e1c7674b5b
[Fix] Fix potential OOM error when loading checkpoint with map_location="cuda:0" (#665)
* [Fix] Change the default value of map_location in PretrainedInit to cpu

* Fix as comment
2022-11-02 19:33:33 +08:00
Yanhong Zeng
618a063ddc
[Docs] Fix docstring and documentation used for hub.get_model (#659)
* fix docstring and documentation used for hub.get_model

* fix config name in test_hub

* fix docstring mentioned faster-rcnn in utils
2022-11-02 10:16:56 +08:00
Mashiro
3aba989fbc
[Docs] Fix docstring of BaseDataset (#656)
* [Fix] Fix docstring of BaseDataset

* minor refine
2022-11-01 17:31:09 +08:00
Sanbu
5b0d4f3e64
[Fix] Set the default value of encoding in Config to utf-8 (#653) 2022-11-01 17:29:17 +08:00
BigDong
376251961d
[Enhance] Add ignore_keys in ConcatDataset (#556)
* [Fix] Fix ConcatDataset error in VOCDataset

* minor fix

* minor fix

* minor fix

* add UT

* minor fix

* minor fix

* minor fix

* Update mmengine/dataset/dataset_wrapper.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* minor fix

* Update mmengine/dataset/dataset_wrapper.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-11-01 17:06:02 +08:00
Sanbu
da9d61f65c
[Doc]: Fix docstring of Config (#654) 2022-11-01 16:56:52 +08:00
Z-Fran
090104df21
[Fix] Fix the calculation error of eta_min in CosineRestart (#639)
* [Fix] fix CosineRestart eta_min

* add ut case

* Enhance unit test

Enhance unit test

* remove unused code

Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>
2022-11-01 15:48:39 +08:00
Sanbu
64ac14303f
[Fix] Fix open() encoding problem of Config in Windows (#648)
* fix open in windows

* Update config.py

* Update config.py

* Update config.py
2022-10-31 14:53:59 +08:00
Mashiro
d1d32df973
Change strict_load of EMAHook to False by default (#642)
* [Fix] resume std and mean

* refine docstring

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-10-28 19:58:43 +08:00
Mashiro
4aad15df90
[Enhancement] Deprecate _save_to_state_dict implemented in mmengine (#610)
* [Refine] Make get_state_dict directly call nn.Module._save_to_state_dict

* deprecate _save_to_state_dict

* deprecate _save_to_state_dict in 0.5.0

* deprecate in 0.3.0

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-10-28 17:14:08 +08:00
Mashiro
d1dd240796
[Fix] Fix BaseDataPreprocessor.cast_data cound not handle string data (#602)
* [Fix] Fix  cound not handle string data

* Minor refine

* Refine type hint

Refine type hint

* fix as comment

* Minor refine

* Update mmengine/model/base_model/data_preprocessor.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-10-28 15:17:27 +08:00
Mashiro
1bf5c0c12e
[Fix] Fix error implementation of is_model_wrapper (#640)
* [Fix] Fix is_model_wrapper

* [Fix] Fix is_model_wrapper
2022-10-28 15:16:56 +08:00
Hakjin Lee
0857f9fb40
[Feature] Support torch ZeroRedundancyOptimizer (#551)
* [Feature] Support torch ZeRORedundancyOptimizer

Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Signed-off-by: Junhwa Song <ethan9867@gmail.com>
Signed-off-by: Hakjin Lee <nijkah@gmail.com>

* lint

* Fix saving optimizer state_dict

* Fix handling import error

* Add test case

* fix UT

* Revert "fix UT"

This reverts commit dd64538960ff7440c6020f533d43945ffc23f2d2.

* fix handling import in UT

* Fix saving zero checkpoint and delete redundant master_only

* lint

* test unittest

* Fix handling impor error

* Fix UT condition

* Edit docstrings

* Fix typo

* Skip redundant procudure in checkpoint hook

* fix typo again

* Update mmengine/optim/optimizer/zero_optimizer.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Add api info

* lint

* Fix lint

* Handling AmpOptimWrapper case

* handling overlap_with_ddp

* Fix error

Signed-off-by: Junhwa Song <ethan9867@gmail.com>
Signed-off-by: Hakjin Lee <nijkah@gmail.com>
Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-10-27 20:31:50 +08:00
tripleMu
bf369da22a
Fix typo (#644)
Fix typo
2022-10-27 00:31:05 +08:00
Mashiro
c1447734c2
[Enhance] Call register_all_modules in Registry.get() (#541)
* call register_all_modules  in Registry.get()

* Fix ci

* fix scope bug (scope_name -> scope), for temp sync

* Fix unit test

* Refine log information

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Fix typo

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-10-24 20:15:14 +08:00
Mashiro
bda92b49e7
[Feature] Add a function to mark the deprecated function. (#609)
* [Enhancement] Add a deprecated function

* Refine and add ut

* tmp save

* minor refine

* Fix unit test

* Fix unit test

* fix docstring

* Update utils.rst
2022-10-24 14:49:48 +08:00
wangjiangben-hw
601db12d38
[Feature] Support engine with NPU backend. (#572)
* init npu

* Update mmengine/optim/optimizer/amp_optimizer_wrapper.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/dist/dist.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* change to is_hccl_backend

* Update mmengine/optim/optimizer/amp_optimizer_wrapper.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* add comment with AmpOptimWrapper

* Update mmengine/runner/amp.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/runner/amp.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* add npu fn in base_model

* Update mmengine/optim/optimizer/amp_optimizer_wrapper.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* clean lint

* Update mmengine/optim/optimizer/amp_optimizer_wrapper.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/model/base_model/base_model.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* add is_npu_available

* try to fix

* Add comments

* Refine grammar

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>
2022-10-24 11:42:29 +08:00
shenmishajing
d270516fe8
[Fix]: fix add_config func is not called bug (#613)
* fix add_config func is not called bug
fix wandb add_config bug
add wandb log_code feature

* move log_code_name param to the last one
add log_code_name param to docstring

* add config only when there is a cfg

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* add unit test for log_code_name param of WandbVisBackend

* Update mmengine/visualization/vis_backend.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* use log_code_kwargs instead of only log_code_name
add PATH_FILTERS registry

* use log_code_kwargs instead of only log_code_name
add PATH_FILTERS registry

* fix add config unit test

* roll back to log_code_name version

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-10-24 09:58:10 +08:00
Zaida Zhou
29390688cb
[Feats]: Add ROCm info when collecting env (#633)
* Add ROCm info when collecting env

* minor fix
2022-10-21 14:02:26 +08:00
Mashiro
aaba1d8871
[Fix] Fix error format of log message (#508)
* Fix error format of log message

* Fix unit test

* remove unnecessary comment
2022-10-18 18:04:15 +08:00
Mashiro
abe56651db
[Fix] Make autocast compatible with mps (#587)
* [Fix] Make autocast compatible with mps

* Enhance unit test

* fix unit test

* clean the code

* fix unit test
2022-10-18 18:03:17 +08:00
Mashiro
6073d9ebd8
[Enhance] add documents for clip_grad , and support clip grad by value. (#513)
* [Enhance] add documents for , and support clip grad by value

* refine docstring

* fix as comment

* Fix as comment

* minor refine

* minor refine

* remove error comment for clip grad

* refine docstring
2022-10-18 18:02:46 +08:00
jbwang1997
4111cfb511
[FIx] Fix the total number of iterations in log is a float number. (#604)
* Update

* Ensure max_iters being integer number
2022-10-18 18:02:12 +08:00
shenmishajing
c2982723c9
[Feats]: add non_blocking feature to BaseDataPreprocessor (#618)
* add non_blocking feature to BaseDataPreprocessor

* Update mmengine/model/base_model/data_preprocessor.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* move new parameters to the last to avoid bc issue

* Update mmengine/model/base_model/data_preprocessor.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmengine/model/base_model/data_preprocessor.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-10-18 17:58:51 +08:00
Mashiro
13484aae9f
Bump version to v0.2.0 (#591)
* Bump version to v0.2.0

* Add changelog

* minor refine

* minor refine

* update date

* clean the code

* minor refine

* update release date

* Fix grammar

* Fix grammar

* Fix grammar

* Fix grammar

* Minor refine

* Fix error format in readme

* update date

* minor refine

* minor refine

* minor refine

* minor refine

* refine grammar
2022-10-11 23:08:17 +08:00
Mashiro
2df5bc137b
[Fix] Fix base tta model (#593)
Co-authored-by: ubuntu <ubuntu@localhost.localdomain>
2022-10-11 09:49:50 +08:00
whcao
46add351fe
[Fis] Set _is_init to True when pretrained is True (#555)
* set _is_init to True when pretrained is True

* fix comments
2022-10-10 17:31:43 +08:00
Mashiro
62456217f9
[Feature] Add test time augmentation base model. (#538)
* First commit

* add BaseTestTimeAugModel

* Add unit test

* move loop logic to test_step

* fix ddp test

* rename model to module

* optim __init__

* Fix as comment

* Fix as comment

* make val_step should not be called

* make tta do not inherit base model

* Fix unit test

* Enhance docstring

* Fix as comment

* Fix as comment

* minor refine

* minor refine

* minor refine

* fix unit test

* minor refine

* minor refine

* minor refine

* minor refine

* minor refine

* minor refine

* fix unit test
2022-10-10 14:29:33 +08:00
Mashiro
b5fd38ab8c
[Enhance]: make total loss at the end of all losses (#369) 2022-10-09 15:37:59 +08:00
Yanyi Liu
ccb32c7e31
[Fix] fix loss smooth when loss name doesn't start with loss (#539)
* fix loss mean

* update
2022-10-08 19:53:05 +08:00
Younghwan Na
da38b4113d
Fix typo in FSDP (#569) 2022-10-08 19:51:07 +08:00
Austin Welch
8864bd88d7
[Feats]: Add smddp dist backend option (#579)
* Add smddp dist backend option

* [Dev]: Upgrade pre commit hooks (#576)

* Upgrade the versions of pre-commit-hooks

* update zh-cn.yaml

* [Docs] Fix the docstring of model sub-package (#573)

* [Doc]: Update config.md (#562)

* Update config.md

* Update config.md

* [Doc] delete the error comment  in docs (#514)

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Zhengfei-0311 <78833899+Zhengfei-0311@users.noreply.github.com>
Co-authored-by: vansin <msnode@163.com>
2022-10-08 19:50:32 +08:00
Mashiro
89146a5b90
[Fix] Fix detect_anomalous_params (#588) 2022-10-08 19:48:35 +08:00
Zaida Zhou
a5eb179153
[Docs] Fix the docstring of model sub-package (#573) 2022-10-08 11:19:30 +08:00
Zaida Zhou
26e5462447
[Dev]: Upgrade pre commit hooks (#576)
* Upgrade the versions of pre-commit-hooks

* update zh-cn.yaml
2022-10-08 10:31:19 +08:00
Hakjin Lee
36af1f0fee
[Fix]: use get instead of pop to get runner_type (#549) 2022-09-26 14:39:06 +08:00
Zaida Zhou
ed84dfd34d
[Refactor] Refactor fileio without breaking back compatibility (#533)
* [Refactor] Refactor fileio but without breaking bc

* handle compatibility

* fix format

* modify io functions

* fix ut

* fix ut

* rename method names

* refine

* refine docstring

* fix ut in windows

* update ut

* minor fix

* ensure client is not None when closing it

* add more examples for list_dir_or_file interface

* refine docstring

* refine deprecated info

* fix ut

* add a description for lmdb docstring
2022-09-26 14:30:40 +08:00
Mashiro
8d14eb6546
[Fix] Support compare numpy array dataset meta (#511)
* [Fix] Support compare numpy array dataset meta

* Add comment
2022-09-22 14:11:00 +08:00
Mashiro
2e99ea3821
[Fix]: Fix _save_to_state_dict (#542) 2022-09-22 14:10:35 +08:00
Qian Zhao
c64243aa9e
[Fix] CheckpointHook behavior incorrect if given filename_tmpl argument (#518) 2022-09-22 12:47:45 +08:00
jason_w
e56b1736c1
[Enhancement]: Remove unnecessary "if statement" (#536)
Remove unnecessary "if statement".
2022-09-19 00:14:18 +08:00
Mashiro
8ee31dbc3b
[Feature] Support convert BN to SyncBN by config (#506)
* [Feature] Support convert BN to SyncBN by config

* make unit test compatible with cpu

* Fix as comment

* fix unit test

* change signature of convert_sync_batchnorm: rename sync_bn to implemention

* fix unit test

* fix unit test
2022-09-15 18:08:36 +08:00
Mashiro
ca0364bbc3
[Fix] Fix merge ci & multiprocessing unit test (#529)
* fix merge ci

* make timeout larger
2022-09-14 09:49:23 +08:00
wxDai
7520210314
[Doc]: fix typo in instance_data.py (#530) 2022-09-14 09:48:32 +08:00
MengzhangLI
c1178fad8f
[Doc] Fix typo in docstring (#527) 2022-09-13 14:55:59 +08:00
Mashiro
6b1b8a3751
[Fix] Fix unit test in windows (#515) 2022-09-13 11:46:21 +08:00
Mashiro
0fb2b8ca8c
[Fix] Fix circle import in EMAHook (#523) 2022-09-09 19:33:27 +08:00
RangiLyu
3ba50ce137
[Enhance] Use torch.lerp_() to speed up EMA. (#519) 2022-09-09 11:44:58 +08:00