mirrors
/
mmengine
mirror of https://github.com/open-mmlab/mmengine.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
247 Commits
31 Branches
27 Tags
20 MiB
Commit Graph

247 Commits (e877862d5b94876fda62c47ec7f5c0aa0c5d3275)
 

Author SHA1 Message Date
Zaida Zhou e877862d5b
[Docs] Improve docstring (#324) 
* Fix docstring format of BaseDataElement

* fix docstring
 2022-06-23 16:08:56 +08:00
Mashiro a4f5533db6
fix torch 1.10 amp error (#330) 2022-06-22 23:12:20 +08:00
Haian Huang(深度眸) 2b8a32eca0
[Fix]: fix RuntimeError of SyncBuffersHook (#309) 
* fix RuntimeError of SyncBuffersHook

* add UT
 2022-06-22 20:00:46 +08:00
Alex Yang e18832f046
[Feat] Support revert syncbn (#326) 
* [Feat] Support revert syncbn

* use logger.info but not warning

* fix info string
 2022-06-22 19:50:54 +08:00
Mashiro 312f264ecd
[Feature] Add autocast wrapper (#307) 
* add autocast wrapper

* fix docstring

* fix docstring

* fix compare version

* fix unit test

* fix incompatible arguments

* fix as comment

* fix unit test

* rename auto_cast to autocast
 2022-06-22 19:49:20 +08:00
Alex Yang 216521a936
[Feat] Support save best ckpt (#310) 
* [Feat] Support save best ckpt

* reformat code

* rename function and reformat code

* fix logging info
 2022-06-22 19:48:46 +08:00
Zaida Zhou c451e71998
Add storage backends in init file (#325) 2022-06-22 19:41:31 +08:00
Mashiro 7154df2618
[Enhance] LogProcessor support custom significant digit (#311) 
* LogProcessor support custom significant digit

* rename to num_digits
 2022-06-22 19:35:52 +08:00
Jiazhen Wang 2086bc4554
[Feature] Fully support to use MLU for training (#313) 
* modify cuda() to to()

* rollback load_checkpoint

* refine runner

* add TODO
 2022-06-22 19:33:35 +08:00
Mashiro afeac1c098
[Feature]: support to dump result in LoggerHook.after_test_epoch (#321) 2022-06-22 19:10:58 +08:00
Zaida Zhou 6501d21eab
[Fix]: fix mdformat version to support python3.6 (#315) 2022-06-21 16:32:58 +08:00
Alex Yang dceef1f66f
[Refactor] Refactor `after_val_epoch` to make it output metric by epoch (#278) 
* [Refactor]:Refactor `after_val_epoch` to make it output metric by epoch

* add an option for user to choose the way of outputing metric

* rename variable

* reformat docstring

* add type alias

* reformat code

* add test function

* add comment and test code

* add comment and test code
 2022-06-21 15:39:59 +08:00
Alex Yang ef946404e6
[Feat] Support FSDP Training (#304) 
* [Feat] Support FSDP Training

* fix version comparison

* change param format and move `FSDP_WRAP_POLICY` to wrapper file

* add docstring and type hint,reformat code

* fix type hint

* fix typo, reformat code
 2022-06-21 15:32:56 +08:00
Zaida Zhou e76517c63a
[Doc]: Update hooks docs (#317) 2022-06-21 15:13:53 +08:00
Zaida Zhou d09af9ead4
[Doc]: update root registries in docs (#316) 2022-06-21 15:12:49 +08:00
Tao Gong 45f5859b50
[Doc]: refactor docs for basedataset (#318) 2022-06-21 14:58:10 +08:00
Mashiro 44538e56c5
[Doc]: refine logging doc (#320) 2022-06-21 14:55:21 +08:00
Jiazhen Wang e1422a34a3
[Fix]: Fix missing schedulers in __init__.py of schedulers (#319) 2022-06-21 14:40:00 +08:00
RangiLyu e470c3aa1b
[Fix]: fix SWA in pytorch 1.6 (#312) 2022-06-21 14:35:22 +08:00
Mashiro bc763758d8
Fix resource package in windows (#308) 
* move import resource

* move import resource
 2022-06-17 14:43:27 +08:00
Mashiro 4a4d6b1ab2
[Enhance] dump messagehub in runner.resume (#237) 
* [Enhance] dump messagehub in runner.resume

* delete unnecessary code

* delete debugging code

Co-authored-by: imabackstabber <312276423@qq.com>
 2022-06-17 11:10:37 +08:00
Mashiro 7129a98e36
[Fix]: fix log processor to log average time and grad norm (#292) 2022-06-17 10:54:20 +08:00
Jiazhen Wang 7b55c5bdbf
[Feature] Support resume from Ceph (#294) 
* support resume from ceph

* move func and refine

* delete symlink

* fix unittest

* perserve _allow_symlink and symlink
 2022-06-17 10:37:19 +08:00
Jiazhen Wang d0d7174274
[Feature] Support MLU Devices (#288) 
* support mlu

* add ut and refine docstring
 2022-06-16 20:28:09 +08:00
Mashiro e1ed5669d5
set resource limit in runner (#306) 2022-06-15 21:01:13 +08:00
Mashiro 7d3224bf46
[Fix] Fix setLevel of MMLogger (#297) 
* Fix setLevel of MMLogger

Fix setLevel of MMLogger

* add docstring and comment
 2022-06-14 14:54:25 +08:00
RangiLyu 1c18f30854
[Enhance] Support infinite dataloader iterator wrapper for IterBasedTrainLoop. (#289) 2022-06-14 14:52:59 +08:00
Alex Yang 5016332588
[Feat] support registering function (#302) 2022-06-14 14:50:24 +08:00
RangiLyu 4cd91ffe15
[Feature] Dump predictions to a pickle file for offline evaluation. (#293) 
* [Feature] Dump predictions to pickle file for offline evaluation.

* print_log
 2022-06-14 14:48:21 +08:00
Mashiro b7866021c4
[Refactor] Refactor the accumulate gradient implemention of OptimWrapper (#284) 
* merge context

* update unit test

* add docstring

* fix bug in AmpOptimWrapper

* add docstring for backward

* add warning and docstring for accumuate gradient

* fix docstring

* fix docstring

* add params_group method

* fix as comment

* fix as comment

* make default_value of loss_scale to dynamic

* Fix docstring

* decouple should update and should no sync

* rename attribute in OptimWrapper

* fix docstring

* fix comment

* fix comment

* fix as comment

* fix as comment and add unit test
 2022-06-13 23:20:53 +08:00
Miao Zheng fd295741ca
[Features]Add OneCycleLR (#296) 
* [Features]Add OnecycleLR

* [Features]Add OnecycleLR

* yapf disable

* build_iter_from_epoch

* add epoch

* fix args

* fix according to comments;

* lr-param

* fix according to comments

* defaults -> default to

* remove epoch and steps per step

* variabel names
 2022-06-13 21:23:59 +08:00
Mashiro 8b0c9c5f6f
[Fix] fix build train_loop during test (#295) 
* fix build train_loop during test

* fix build train_loop during test

* fix build train_loop during test

* fix build train_loop during test

* Fix as comment
 2022-06-13 21:23:46 +08:00
RangiLyu 819e10c24c
[Fix] Fix image dtype when enable_normalize=False. (#301) 
* [Fix] Fix image dtype when enable_normalize=False.

* update ut

* move to collate

* update ut
 2022-06-13 21:21:19 +08:00
Mashiro bcab813242
[Feature] Add ModuleList Sequential and ModuleDict (#299) 
* add module list

* add module list

* fix docstring
 2022-06-13 13:51:07 +08:00
Alex Yang df0c510444
[Feat]:support customizing evaluator (#287) 
* [Feat]:support customizing evaluator

* fix keyname of determining using default evaluator or not

* add assertion

* fix typo
 2022-06-10 15:34:10 +08:00
liukuikun c90b95a44b
[Fix]: fix label data and support empty tensor in label_to_onehot (#291) 2022-06-10 15:12:41 +08:00
RangiLyu 2f16ec69fb
[Feature] Support overwrite default scope with "_scope_". (#275) 
* [Feature] Support overwrite default scope with "_scope_".

* add ut

* add ut
 2022-06-09 20:16:31 +08:00
jbwang1997 7a5d3c83ea
[Fix] Replace auto_scale_lr_cfg to auto_scale_lr (#286) 
* Replace auto_scale_lr_cfg to auto_scale_lr

* Update
 2022-06-09 20:15:36 +08:00
Mashiro 931db99005
[Enhance] Enhance img data preprocessor (#290) 
* fix BaseDataPreprocessor

* fix BaseDataPreprocessor

* change device type to torch.device

* change device type to torch.device

* fix cpu method of base model

* Allow ImgDataPreprocessor do not normalize

* remove unnecessary type ignore

* make mean and std optional

* refine docstring
 2022-06-09 20:12:15 +08:00
Yixiao Fang 8b3675a2aa
[Enhance] support to add custom settings to param_group (#283) 2022-06-09 20:11:19 +08:00
Mashiro a9afdad7a8
[Fix] Fix BaseDataPreprocessor and BaseModel (#285) 
* fix BaseDataPreprocessor

* fix BaseDataPreprocessor

* change device type to torch.device

* change device type to torch.device

* fix cpu method of base model
 2022-06-09 11:45:19 +08:00
RangiLyu 6f321f88ee
[Enhance] Optimize parameter updating speed in AveragedModel. (#281) 
* [Enhance] Optimize parameter updating speed in AveragedModel.

* add docstring
 2022-06-08 16:38:27 +08:00
Mashiro 6ee675430f
[Refactor]: change order of BaseModel arguments (#282) 2022-06-08 13:28:00 +08:00
Mashiro f04fec736d
[Feature]: add base model, ddp model wrapper and unit test (#268) 
* add base model, ddp model and unit test

* add unit test

* fix unit test

* fix docstring

* fix cpu unit test

* refine base data preprocessor

* refine base data preprocessor

* refine interface of ddp module

* remove optimizer hook

* add forward

* fix as comment

* fix unit test

* fix as comment

* fix build optimizer wrapper

* rebase main and fix unit test

* stack_batch support stacking ndim tensor, add docstring for merge dict

* fix lint

* fix test loop

* make precision_context effective to data_preprocessor

* fix as comment

* fix as comment

* refine docstring

* change collate_data output typehints

* rename to_rgb to bgr_to_rgb and rgb_to_bgr

* support build basemodel with built DataPreprocessor

* fix as comment

* fix docstring
 2022-06-07 22:13:53 +08:00
RangiLyu ad965a5309
[Enhance] Enhance checkpoint meta info. (#279) 2022-06-07 18:48:50 +08:00
Mashiro 538ff48aec
[Fix] Rename data_list and support loading from ceph in dataset (#240) 
* rename datalist and support load ceph

* rename datalist and support load ceph

* remove check disk file path in _load_metainfo

* fix rename error

* fix rename error

* unit test error

* fix rename error

* remove unnecessary code

* fix lint
 2022-06-07 17:09:33 +08:00
jbwang1997 bd3c53b385
[Fix] Fix CI after merging support auto scale lr and support custom runner (#280) 2022-06-07 16:03:51 +08:00
jbwang1997 8f3fcee301
[Feature] Add auto scale lr fucntion (#270) 
* Add auto scale lr fucntion

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

Co-authored-by: wangjiabao1.vendor <wangjiabao@pjlab.org.cn>
 2022-06-06 22:27:15 +08:00
Jiazhen Wang 65bc95036c
[Enhance] Support Custom Runner (#258) 
* support custom runner

* change build_runner_from_cfg

* refine docstring

* refine docstring
 2022-06-06 14:33:32 +08:00
Haian Huang(深度眸) 94c7c3be2c
[Enhance]: remove warning in vis_backend (#273) 
* fix visbackend warning

* fix
 2022-06-06 14:02:15 +08:00