Hakjin Lee
0857f9fb40
[Feature] Support torch ZeroRedundancyOptimizer ( #551 )
...
* [Feature] Support torch ZeRORedundancyOptimizer
Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Signed-off-by: Junhwa Song <ethan9867@gmail.com>
Signed-off-by: Hakjin Lee <nijkah@gmail.com>
* lint
* Fix saving optimizer state_dict
* Fix handling import error
* Add test case
* fix UT
* Revert "fix UT"
This reverts commit dd64538960
.
* fix handling import in UT
* Fix saving zero checkpoint and delete redundant master_only
* lint
* test unittest
* Fix handling impor error
* Fix UT condition
* Edit docstrings
* Fix typo
* Skip redundant procudure in checkpoint hook
* fix typo again
* Update mmengine/optim/optimizer/zero_optimizer.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Add api info
* lint
* Fix lint
* Handling AmpOptimWrapper case
* handling overlap_with_ddp
* Fix error
Signed-off-by: Junhwa Song <ethan9867@gmail.com>
Signed-off-by: Hakjin Lee <nijkah@gmail.com>
Co-authored-by: Junhwa Song <ethan9867@gmail.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-10-27 20:31:50 +08:00
Mashiro
bda92b49e7
[Feature] Add a function to mark the deprecated function. ( #609 )
...
* [Enhancement] Add a deprecated function
* Refine and add ut
* tmp save
* minor refine
* Fix unit test
* Fix unit test
* fix docstring
* Update utils.rst
2022-10-24 14:49:48 +08:00
wangjiangben-hw
601db12d38
[Feature] Support engine with NPU backend. ( #572 )
...
* init npu
* Update mmengine/optim/optimizer/amp_optimizer_wrapper.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/dist/dist.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* change to is_hccl_backend
* Update mmengine/optim/optimizer/amp_optimizer_wrapper.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* add comment with AmpOptimWrapper
* Update mmengine/runner/amp.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/runner/amp.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* add npu fn in base_model
* Update mmengine/optim/optimizer/amp_optimizer_wrapper.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* clean lint
* Update mmengine/optim/optimizer/amp_optimizer_wrapper.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/model/base_model/base_model.py
Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
* add is_npu_available
* try to fix
* Add comments
* Refine grammar
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>
2022-10-24 11:42:29 +08:00
Mashiro
62456217f9
[Feature] Add test time augmentation base model. ( #538 )
...
* First commit
* add BaseTestTimeAugModel
* Add unit test
* move loop logic to test_step
* fix ddp test
* rename model to module
* optim __init__
* Fix as comment
* Fix as comment
* make val_step should not be called
* make tta do not inherit base model
* Fix unit test
* Enhance docstring
* Fix as comment
* Fix as comment
* minor refine
* minor refine
* minor refine
* fix unit test
* minor refine
* minor refine
* minor refine
* minor refine
* minor refine
* minor refine
* fix unit test
2022-10-10 14:29:33 +08:00
Zaida Zhou
ed84dfd34d
[Refactor] Refactor fileio without breaking back compatibility ( #533 )
...
* [Refactor] Refactor fileio but without breaking bc
* handle compatibility
* fix format
* modify io functions
* fix ut
* fix ut
* rename method names
* refine
* refine docstring
* fix ut in windows
* update ut
* minor fix
* ensure client is not None when closing it
* add more examples for list_dir_or_file interface
* refine docstring
* refine deprecated info
* fix ut
* add a description for lmdb docstring
2022-09-26 14:30:40 +08:00
Mashiro
8ee31dbc3b
[Feature] Support convert `BN` to `SyncBN` by config ( #506 )
...
* [Feature] Support convert BN to SyncBN by config
* make unit test compatible with cpu
* Fix as comment
* fix unit test
* change signature of convert_sync_batchnorm: rename sync_bn to implemention
* fix unit test
* fix unit test
2022-09-15 18:08:36 +08:00
Zaida Zhou
114fa21522
[Docs] Fix API files of en docs ( #525 )
...
* [Docs] Fix api files of en docs
* minor fix
2022-09-13 14:57:18 +08:00
Zaida Zhou
a06bb7782b
[Docs] Add readthedocs.yml ( #501 )
...
* [Docs] Add readthedocs.yml
* include torch in readthedocs.yml
* add torch torchvision in docs.txt
2022-08-31 23:34:25 +08:00
Zaida Zhou
458f6d684e
[Docs] Refactor docs structure ( #494 )
...
* [WIP] Refactor-docs-structure
* [Docs] Check link and fix rst (#498 )
* check link
* fix rst
* Fix conf.py
* Fix lint
* minor refine
* minor refine
* modify zh_readme and index.rst
* add migration exampls get_started design to en
* add tutorials to en
* correct chinese doc link
* Apply suggestions from code review
* Update docs/en/advanced_tutorials/distributed.md
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
2022-08-31 21:18:55 +08:00
Zaida Zhou
3f5e08fa4a
[Docs] Make API of docs clearer ( #469 )
...
* [Docs] Make API of docs clearer
* minor fix
* fix md format
2022-08-30 16:27:20 +08:00