f850de71c3
[Fix] Support use 'global variable' in config function ( #390 )
...
* Support use 'global var' in config function
* upload test file
2022-08-01 20:10:10 +08:00
4432e54c97
[Fix] Fix gpu tensors in results list are not on the same device. ( #385 )
...
* [Fix] Fix gpu tensors in results list are not on the same device.
* cast all tensor to cpu
2022-08-01 10:20:57 +08:00
39e7efb04d
[Fix] Revise UT of OneCycle schedulor ( #388 )
2022-07-27 16:22:00 +08:00
6bd548d8bb
[FIx] Logging time in LoggerHook.after_val_epoch has no effect ( #376 )
2022-07-20 16:51:11 +08:00
6b47035fdf
[Fix] Fix save scheduler state dict with optim wrapper ( #375 )
...
* fix save scheduler state dict with optim wrapper
* remove for loop and inherit TestParameterScheduler
* remove for loop and inherit TestParameterScheduler
* minor refine
2022-07-20 16:32:48 +08:00
5b065b10fd
[Enhance] Support Compose(None) ( #373 )
...
* [Enhance] Allow Compose(None)
* add typehint
* fix
2022-07-20 16:04:24 +08:00
ea61bf6bb7
Fix: avoid modification of scalar_dict in LocalVisBackend ( #377 )
2022-07-20 16:03:01 +08:00
1241c21296
[Fix] Fix weight initializing in test and refine registry logging. ( #367 )
...
* [Fix] Fix weight initializing and registry logging.
* sync params
* resolve comments
2022-07-19 18:28:57 +08:00
3da66d1f87
[Enhance] Auto set the `end` of param schedulers. ( #361 )
...
* [Enhance] Auto set the `end` of param schedulers.
* Add log output and unit test
* Update docstring
* Update unit tests of `CosineAnnealingParamScheduler`.
2022-07-15 19:53:28 +08:00
78fad67d0d
[Fix] fix resume message_hub ( #353 )
...
* fix resume message_hub
* add unit test
* support resume from messagehub
* minor refine
* add comment
* fix typo
* update docstring
2022-07-14 20:13:22 +08:00
45001a1f6f
[Enhance] Support using variables in base config directly as normal variables. ( #329 )
...
* first commit
* Support modify base config and add unit test
* remove import mmengine in config
* add unit test
* fix lint
* add unit test
* move RemoveAssignFromAST to config utils
* git add utils
* fix format issue in test file
* refine unit test
* refine unit test
2022-07-14 13:05:55 +08:00
6b608b4ef1
[Enhance] Add `build_model_from_cfg` ( #328 )
...
* clean code
* fix as comment
* fix as comment
* add get_registry_by_scope method
* add unit test and docstring example
* rename get_registry_by_scope to switch_scope_and_registry
* move build function to registry/builder
* fix docstring
* rename builder->registry_builder, move build_from_cfg to registry_builder
rename builder->registry_builder, move build_from_cfg to registry_builder
* rename registry_builder to build_function
rename registry_builder to build_function
* fix docstring and type hint
* rename build_function to build_functions
2022-07-13 19:01:59 +08:00
b2ee9f8b11
[Fix] Fix loss could be nan in optimizer wrapper ( #345 )
...
* fix optimizer wrapper counts
* fix ut
2022-07-06 16:42:49 +08:00
a3d2916790
[Enhance] Support scheduling betas with MomentumScheduler. ( #346 )
...
* [Enhance] Support scheduling betas with MomentumScheduler.
* enhance ut
* test adam betas
* enhance ut
* enhance ut
2022-07-05 20:37:23 +08:00
2853045e96
[Fix] Fix build multiple runners error ( #348 )
...
* fix build multiple runner error
* fix comments
* fix cpu ci
2022-07-05 20:35:06 +08:00
38e78d5549
[Fix] Fix ema hook and add unit test ( #327 )
...
* Fix ema hook and add unit test
* save state_dict of ema.module
save state_dict of ema.module
* replace warning.warn with MMLogger.warn
* fix as comment
* fix bug
* fix bug
2022-07-04 14:23:23 +08:00
9c55b4300c
[Enhance] Support dynamic interval ( #342 )
...
* support dynamic interval in iterbasedtrainloop
* update typehint
* update typehint
* add dynamic interval in epochbasedtrainloop
* update
* fix
Co-authored-by: luochunhua.vendor <luochunhua@pjlab.org.cn>
2022-06-30 15:08:56 +08:00
d65350a9da
[Fix] Fix bug of not save-best in iteration-based training ( #341 )
...
* fix bug of not save-best in iteration-based training
* revise the unit test
2022-06-30 14:51:31 +08:00
59b0ccfe6f
[Fix] Fix pytorch version compatibility of autocast ( #339 )
...
* fix unit test of autocast
* fix compatiblity of unit test of optimizerwrapper
* clean code
* fix as comment
* fix docstring
2022-06-29 20:30:53 +08:00
5ac3c23338
[Fix]: fix MMSeparateDistributedDataParallel ( #338 )
2022-06-28 22:20:20 +08:00
d624fa9191
[Enhance] assert image shape before forward ( #300 )
...
* assert image shape before forward
* add unit test
* enhance error message
* allow gray image input
* fix as comment
* fix unit test
* fix unit test
2022-06-28 11:46:12 +08:00
2fd6beb972
[Fix] Fix UT of optimizer wrapper failed in pytorch1.6 ( #340 )
2022-06-28 10:31:14 +08:00
3af3d40541
[Enhance] Refine BaseDataset ( #303 )
...
* refine data_root and data_prefix params
* modify unittest
2022-06-27 14:59:56 +08:00
03d5c17ba6
[Feature]: Set different seed to different rank ( #298 )
...
* [Feature]: Set different seed for diff rank
* [Feature]: Add log
* [Fix]: Fix lint
* [Fix]: Fix docstring
* [Fix]: Fix sampler seed
* [Fix]: Fix log bug
* [Fix]: Change diff_seed to diff_rank_seed
* [Fix]: Fix lint
2022-06-24 14:28:16 +08:00
2994195be2
[Feat] Support training on MPS ( #331 )
...
* [Feat] Support mps
* fix docstring
2022-06-23 16:53:19 +08:00
2b8a32eca0
[Fix]: fix RuntimeError of SyncBuffersHook ( #309 )
...
* fix RuntimeError of SyncBuffersHook
* add UT
2022-06-22 20:00:46 +08:00
e18832f046
[Feat] Support revert syncbn ( #326 )
...
* [Feat] Support revert syncbn
* use logger.info but not warning
* fix info string
2022-06-22 19:50:54 +08:00
312f264ecd
[Feature] Add autocast wrapper ( #307 )
...
* add autocast wrapper
* fix docstring
* fix docstring
* fix compare version
* fix unit test
* fix incompatible arguments
* fix as comment
* fix unit test
* rename auto_cast to autocast
2022-06-22 19:49:20 +08:00
216521a936
[Feat] Support save best ckpt ( #310 )
...
* [Feat] Support save best ckpt
* reformat code
* rename function and reformat code
* fix logging info
2022-06-22 19:48:46 +08:00
7154df2618
[Enhance] LogProcessor support custom significant digit ( #311 )
...
* LogProcessor support custom significant digit
* rename to num_digits
2022-06-22 19:35:52 +08:00
afeac1c098
[Feature]: support to dump result in LoggerHook.after_test_epoch ( #321 )
2022-06-22 19:10:58 +08:00
dceef1f66f
[Refactor] Refactor `after_val_epoch` to make it output metric by epoch ( #278 )
...
* [Refactor]:Refactor `after_val_epoch` to make it output metric by epoch
* add an option for user to choose the way of outputing metric
* rename variable
* reformat docstring
* add type alias
* reformat code
* add test function
* add comment and test code
* add comment and test code
2022-06-21 15:39:59 +08:00
ef946404e6
[Feat] Support FSDP Training ( #304 )
...
* [Feat] Support FSDP Training
* fix version comparison
* change param format and move `FSDP_WRAP_POLICY` to wrapper file
* add docstring and type hint,reformat code
* fix type hint
* fix typo, reformat code
2022-06-21 15:32:56 +08:00
4a4d6b1ab2
[Enhance] dump messagehub in runner.resume ( #237 )
...
* [Enhance] dump messagehub in runner.resume
* delete unnecessary code
* delete debugging code
Co-authored-by: imabackstabber <312276423@qq.com>
2022-06-17 11:10:37 +08:00
7129a98e36
[Fix]: fix log processor to log average time and grad norm ( #292 )
2022-06-17 10:54:20 +08:00
7b55c5bdbf
[Feature] Support resume from Ceph ( #294 )
...
* support resume from ceph
* move func and refine
* delete symlink
* fix unittest
* perserve _allow_symlink and symlink
2022-06-17 10:37:19 +08:00
d0d7174274
[Feature] Support MLU Devices ( #288 )
...
* support mlu
* add ut and refine docstring
2022-06-16 20:28:09 +08:00
7d3224bf46
[Fix] Fix setLevel of MMLogger ( #297 )
...
* Fix setLevel of MMLogger
Fix setLevel of MMLogger
* add docstring and comment
2022-06-14 14:54:25 +08:00
1c18f30854
[Enhance] Support infinite dataloader iterator wrapper for IterBasedTrainLoop. ( #289 )
2022-06-14 14:52:59 +08:00
5016332588
[Feat] support registering function ( #302 )
2022-06-14 14:50:24 +08:00
4cd91ffe15
[Feature] Dump predictions to a pickle file for offline evaluation. ( #293 )
...
* [Feature] Dump predictions to pickle file for offline evaluation.
* print_log
2022-06-14 14:48:21 +08:00
b7866021c4
[Refactor] Refactor the accumulate gradient implemention of OptimWrapper ( #284 )
...
* merge context
* update unit test
* add docstring
* fix bug in AmpOptimWrapper
* add docstring for backward
* add warning and docstring for accumuate gradient
* fix docstring
* fix docstring
* add params_group method
* fix as comment
* fix as comment
* make default_value of loss_scale to dynamic
* Fix docstring
* decouple should update and should no sync
* rename attribute in OptimWrapper
* fix docstring
* fix comment
* fix comment
* fix as comment
* fix as comment and add unit test
2022-06-13 23:20:53 +08:00
fd295741ca
[Features]Add OneCycleLR ( #296 )
...
* [Features]Add OnecycleLR
* [Features]Add OnecycleLR
* yapf disable
* build_iter_from_epoch
* add epoch
* fix args
* fix according to comments;
* lr-param
* fix according to comments
* defaults -> default to
* remove epoch and steps per step
* variabel names
2022-06-13 21:23:59 +08:00
8b0c9c5f6f
[Fix] fix build train_loop during test ( #295 )
...
* fix build train_loop during test
* fix build train_loop during test
* fix build train_loop during test
* fix build train_loop during test
* Fix as comment
2022-06-13 21:23:46 +08:00
819e10c24c
[Fix] Fix image dtype when enable_normalize=False. ( #301 )
...
* [Fix] Fix image dtype when enable_normalize=False.
* update ut
* move to collate
* update ut
2022-06-13 21:21:19 +08:00
bcab813242
[Feature] Add ModuleList Sequential and ModuleDict ( #299 )
...
* add module list
* add module list
* fix docstring
2022-06-13 13:51:07 +08:00
df0c510444
[Feat]:support customizing evaluator ( #287 )
...
* [Feat]:support customizing evaluator
* fix keyname of determining using default evaluator or not
* add assertion
* fix typo
2022-06-10 15:34:10 +08:00
c90b95a44b
[Fix]: fix label data and support empty tensor in label_to_onehot ( #291 )
2022-06-10 15:12:41 +08:00
2f16ec69fb
[Feature] Support overwrite default scope with "_scope_". ( #275 )
...
* [Feature] Support overwrite default scope with "_scope_".
* add ut
* add ut
2022-06-09 20:16:31 +08:00
7a5d3c83ea
[Fix] Replace auto_scale_lr_cfg to auto_scale_lr ( #286 )
...
* Replace auto_scale_lr_cfg to auto_scale_lr
* Update
2022-06-09 20:15:36 +08:00
931db99005
[Enhance] Enhance img data preprocessor ( #290 )
...
* fix BaseDataPreprocessor
* fix BaseDataPreprocessor
* change device type to torch.device
* change device type to torch.device
* fix cpu method of base model
* Allow ImgDataPreprocessor do not normalize
* remove unnecessary type ignore
* make mean and std optional
* refine docstring
2022-06-09 20:12:15 +08:00
a9afdad7a8
[Fix] Fix BaseDataPreprocessor and BaseModel ( #285 )
...
* fix BaseDataPreprocessor
* fix BaseDataPreprocessor
* change device type to torch.device
* change device type to torch.device
* fix cpu method of base model
2022-06-09 11:45:19 +08:00
6ee675430f
[Refactor]: change order of BaseModel arguments ( #282 )
2022-06-08 13:28:00 +08:00
f04fec736d
[Feature]: add base model, ddp model wrapper and unit test ( #268 )
...
* add base model, ddp model and unit test
* add unit test
* fix unit test
* fix docstring
* fix cpu unit test
* refine base data preprocessor
* refine base data preprocessor
* refine interface of ddp module
* remove optimizer hook
* add forward
* fix as comment
* fix unit test
* fix as comment
* fix build optimizer wrapper
* rebase main and fix unit test
* stack_batch support stacking ndim tensor, add docstring for merge dict
* fix lint
* fix test loop
* make precision_context effective to data_preprocessor
* fix as comment
* fix as comment
* refine docstring
* change collate_data output typehints
* rename to_rgb to bgr_to_rgb and rgb_to_bgr
* support build basemodel with built DataPreprocessor
* fix as comment
* fix docstring
2022-06-07 22:13:53 +08:00
ad965a5309
[Enhance] Enhance checkpoint meta info. ( #279 )
2022-06-07 18:48:50 +08:00
538ff48aec
[Fix] Rename data_list and support loading from ceph in dataset ( #240 )
...
* rename datalist and support load ceph
* rename datalist and support load ceph
* remove check disk file path in _load_metainfo
* fix rename error
* fix rename error
* unit test error
* fix rename error
* remove unnecessary code
* fix lint
2022-06-07 17:09:33 +08:00
bd3c53b385
[Fix] Fix CI after merging support auto scale lr and support custom runner ( #280 )
2022-06-07 16:03:51 +08:00
8f3fcee301
[Feature] Add auto scale lr fucntion ( #270 )
...
* Add auto scale lr fucntion
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
Co-authored-by: wangjiabao1.vendor <wangjiabao@pjlab.org.cn>
2022-06-06 22:27:15 +08:00
65bc95036c
[Enhance] Support Custom Runner ( #258 )
...
* support custom runner
* change build_runner_from_cfg
* refine docstring
* refine docstring
2022-06-06 14:33:32 +08:00
70c4ea191f
[Refactor]: Modify val_interval and val_begin to be the attributes of TrainLoop. ( #274 )
...
* Modify val_interval and val_begin to be the attributes of TrainLoop.
* update doc
* fix lint
* type hint
2022-06-06 11:13:25 +08:00
13606040ac
[Feat]:Add base module ( #277 )
2022-06-06 10:51:23 +08:00
80a46c4848
[Fix] fix build optimizer wrapper without type ( #272 )
...
* fix build optimizer wrapper without type
* refine logic
* fix as comment
* fix optim_wrapper config error in docstring and unit test
* refine docstring of build_optim_wrapper
2022-06-05 22:35:16 +08:00
3e3866c1b9
[Feature] Add optimizer wrapper ( #265 )
...
* Support multiple optimizers
* minor refinement
* improve unit tests
* minor fix
* Update unit tests for resuming or saving ckpt for multiple optimizers
* refine docstring
* refine docstring
* fix typo
* update docstring
* refactor the logic to build multiple optimizers
* resolve comments
* ParamSchedulers spports multiple optimizers
* add optimizer_wrapper
* fix comment and docstirng
* fix unit test
* add unit test
* refine docstring
* RuntimeInfoHook supports printing multi learning rates
* resolve comments
* add optimizer_wrapper
* fix mypy
* fix lint
* fix OptimizerWrapperDict docstring and add unit test
* rename OptimizerWrapper to OptimWrapper, OptimWrapperDict inherit OptimWrapper, and fix as comment
* Fix AmpOptimizerWrapper
* rename build_optmizer_wrapper to build_optim_wrapper
* refine optimizer wrapper
* fix AmpOptimWrapper.step, docstring
* resolve confict
* rename DefaultOptimConstructor
* fix as comment
* rename clig grad auguments
* refactor optim_wrapper config
* fix docstring of DefaultOptimWrapperConstructor
fix docstring of DefaultOptimWrapperConstructor
* add get_lr method to OptimWrapper and OptimWrapperDict
* skip some amp unit test
* fix unit test
* fix get_lr, get_momentum docstring
* refactor get_lr, get_momentum, fix as comment
* fix error message
Co-authored-by: zhouzaida <zhouzaida@163.com>
2022-06-01 18:04:38 +08:00
f1da9a1d7f
[Feature] Support multiple optimizers ( #235 )
...
* Support multiple optimizers
* minor refinement
* improve unit tests
* minor fix
* Update unit tests for resuming or saving ckpt for multiple optimizers
* refine docstring
* refine docstring
* fix typo
* update docstring
* refactor the logic to build multiple optimizers
* resolve comments
* ParamSchedulers spports multiple optimizers
* refine docstring
* RuntimeInfoHook supports printing multi learning rates
* resolve comments
* fix typo
2022-05-31 16:54:39 +08:00
f2190de787
[Enhance] Improve Exception in call_hook ( #247 )
...
* improve exception in call_hook
* refine unit test
* add test_call_hook
* refine
* update docstring and ut
2022-05-31 11:34:30 +08:00
38b22d9e68
[Enhance] Enhance error report when a module has been registered in registery. ( #264 )
...
* Update
* Add unittest
2022-05-31 11:31:04 +08:00
172b9ded4a
[Fix] Fix ema state dict swapping in EMAHook and torch1.5 ut. ( #266 )
...
* [Fix] Fix ema state dict swapping in EMAHook.
* fix pt1.5 ut
* add more comments
2022-05-30 16:51:06 +08:00
40daf46a45
Support validation only after some epoch/iteration in ValLoop ( #257 )
...
* add the epoch/iter that begins validating
* fix lint
* add property and fix unit test
* minor changes
* fix typos and add unit test
* add unit test about begin
* fix docstring
2022-05-27 15:10:12 +08:00
4705e1fe3d
[Enhance] Add RuntimeInfoHook to update runtime information. ( #254 )
...
* [Enhance] Add RuntimeInfoHook to update runtime information.
* move lr to runtime info
* docstring
* resolve comments
* update ut and doc
2022-05-26 14:35:37 +08:00
4cbbbc0c31
[Enhance] Refine sync random seed ( #256 )
...
* refine sync random seed
* cancel seed param in batch-sampler
2022-05-25 19:18:03 +08:00
c197bdf359
[Feature] Profiling tools ( #241 )
...
* Add profiling tools
* fix docstr
* fix docstr
* update
* fix bug
* update
* update
* fix error
* fix mypy
* uodate
* merge main
* fix UT
2022-05-25 10:55:07 +08:00
8d3bd4dfef
Move get_max_cuda_memory and set_multi_processing to public function ( #250 )
...
* move get_max_cuda_memory and set_multi_processing to a public function
* fix lint
* fix lint
* fix lint
* delete _set_multi_processing
* fix error
* rename
2022-05-24 19:36:55 +08:00
a976257ca9
[Enhance] Support Custom LogProcessor ( #251 )
...
* support custom log processor
* supplementary docs
* format code
2022-05-24 17:17:35 +08:00
11688507ba
[Fix] Fix some bugs in hooks and runner. ( #242 )
...
* [Fix] Fix some bugs in hooks and runner.
* fix markdown
* fix latex formula
* resolve comments
2022-05-20 17:18:24 +08:00
0279ac2e8d
[Feature] Support EMA and SWA. ( #239 )
...
* [Feature] Support EMA and SWA.
* add ema hook
* add avg model ut
* add more unit tests
* resolve comments
* fix warmup ema
* rename
* fix comments
* add assert
* fix typehint
* add comments
2022-05-19 18:53:04 +08:00
86ffc19c9c
Add pyupgrade pre-commit hook ( #232 )
...
* Add pyupgrade pre-commit hook
* fix ut
* remove comments
2022-05-19 17:56:31 +08:00
98c85529b1
[Refactor] Replace torch distributed with mmengine dist module ( #196 )
...
* [Fix] Replace torch distributed with mmengine dist module
* minor refinement
* move all_reduce_params to dist.py
* add unit tests
* update unit tests
* fix test_logger.py
* add examples
2022-05-19 17:40:01 +08:00
e37f1f905b
[Refactor] Make loop-related attributes to be runner's properties. ( #236 )
...
* [Enhance] Make loop related attributes to be runner's properties.
* move iter and epoch to loop
* resolve comments
2022-05-18 22:35:10 +08:00
cc8a6b86e1
[Fix] Fix BaseDataset: join prefix in parse_data_info ( #226 )
...
* implement parse_data_info
* add unit test
* fix join prefix of ann_file
* fix docstring
2022-05-17 20:53:13 +08:00
fd962437e9
[Fix] Support Runner dump cfg without filename ( #228 )
...
* fix runner dump cfg
* convert dict cfg to Config
2022-05-17 17:32:10 +08:00
689837d2b8
[Enhancement] add pixel data and label data ( #224 )
2022-05-13 18:23:25 +08:00
1912660db9
[Feature] Support convert epoch-based schedulers to iter-based. ( #221 )
...
* [Feature] Support convert epoch-based schedulers to iter-based.
* Support convert and refactor LR and Momentum to mixin.
* Add unit tests
* fix args and add runner ut
* resolve comments
2022-05-10 15:17:51 +08:00
9087956f70
[Enhance] Update config with newest mmcv and show custom imports error explicitly ( #192 )
...
* add import error information
* Update config with newest mmcv
* add empty line to test config
2022-05-06 22:59:54 +08:00
859f4d1580
[Fix] Fix some code and docstring in LogProcessor and LoggerHook ( #213 )
...
* fix logger hook
* fix to record multi-level logs, log train/a/b to a/b
* fix loggerhook json path
* fix uunit test
* change runner.train_dataloader to runner.train_loop.dataloader
* clean debug code
* refie comments and docstring
* fix unit test
2022-05-06 14:33:33 +08:00
5c5c03e648
[Enchance] cat empty instancedata, support torch.bool for more type ( #209 )
...
* refactor instancedata
* fix docs
* fix comment
2022-05-06 14:00:51 +08:00
16058fdb18
[Fix] Fix RecursionError when key is invalid ( #220 )
...
* [Fix] Fix RecursionError when key is invalid
* refine comments
2022-05-05 20:09:03 +08:00
5007825619
[Fix] change CheckPointHook before_run to before train ( #214 )
...
* change CheckPointHook before_run to before train
* using tmp_path in each checkpointhook test case
2022-05-05 20:08:07 +08:00
4742544b25
[Feature] Support collect all registered module info. ( #193 )
...
* [Feature] Support collect all registered module info.
* update
* update
* add unit tests
* add to runner
* resolve comments
2022-05-05 11:59:51 +08:00
29342c4eb2
[Fix] Fix to_dict in BaseDataElement and add metainfo property. ( #215 )
...
* [Fix] Fix to_dict in BaseDataElement and add metainfo property.
* Update mmengine/data/base_data_element.py
Co-authored-by: liukuikun <24622904+Harold-lkk@users.noreply.github.com>
Co-authored-by: liukuikun <24622904+Harold-lkk@users.noreply.github.com>
2022-04-29 10:19:19 +08:00
05fd5e81a3
[Enhance] Refine MMLogger and change save dir of MMLogger and Visualizer ( #205 )
...
* MMLogger can call get_current_instance without get_instance, change log path
* fix docstring
* fix docstring and update UT
* Fix runner
* fix docstring and lint
* fix ut below python3.8
* resolve circle import
2022-04-27 20:47:14 +08:00
db2b45b7ac
[Fix] Fix the probable failure of the basedataset unit test ( #210 )
2022-04-27 19:48:28 +08:00
17dbac1812
[Enhancement] Handle the device type of inputs in functions ( #137 )
...
* [Enhancement] Handle the device type of inputs in functions
* rename and move three fucntions to dist/utils.py
* minor refinement
* rename dist to torch_dist in utils.py
* update unit tests
* refine unit tests
* add unit tests
* fix unit tests
* replace Sequence with list and tuple
* rename get_backend_device to get_comm_device
* fix unit tests
* fix unit tests
* refactor and add more unit tests
* cast_data_device does not support set type
2022-04-27 19:46:13 +08:00
661e759063
[Fix] param_scheduler can not None when training models ( #208 )
...
* [Fix] param_scheduler can not None when training models
* update unit tests
* fix unit tests
* refactor ParamSchedulerHook
* refactor unit tests
* param_schedulers can be an empty list
2022-04-27 19:45:27 +08:00
6996bdc892
Update visualizer code ( #184 )
...
* update vis backend
* update vis backend
* update vis backend
* update visualizer
* update visualizer
* update visualizer
* update featmap
* update featmap
* update visualizer and unitest
* add draw points unitest and refactor vis_backend
* fix typo and close unitest
* fix comment
* add docstring
* fix comment
* add master only
* fix comment
Co-authored-by: liukuikun <641417025@qq.com>
2022-04-27 19:44:40 +08:00
452b3656a1
[Fix] Fix dump config without self.filename ( #202 )
...
* fix config
* add docstring and unit test
* update tutorial
* update tutorial
* fix markdown format
* fix markdown format
2022-04-27 19:43:12 +08:00
4dcbd269aa
[Enhance] register dataset wrapper ( #185 )
...
* register dataset wrapper
* fix as comment
2022-04-26 16:52:13 +08:00
96f3d97fc4
Try to fix lint issue ( #199 )
...
* try to fix lint
* upgrade yapf version
* use another way to bypass yapf
* update docstring
2022-04-26 13:53:00 +08:00
e0d00c5bdd
[Fix] resolve conflict betweem adapt and main. ( #198 )
...
* [Docs] Refine registry documentation (#186 )
* [Docs] Refine registry documentation
* reslove comments
* minor refinement
* Refine Visualizer docs (#177 )
* Refine Visualizer docs
* update
* update
* update featmap
* update docs
* update visualizer docs
* [Refactor] Refine LoggerHook (#155 )
* rename global accessible and intergration get_sintance and create_instance
* move ManagerMixin to utils
* fix as docstring and seporate get_instance to get_instance and get_current_instance
* fix lint
* fix docstring, rename and move test_global_meta
* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume
* refine MMLogger timestamp, update unit test
* MMLogger add logger_name arguments
* Fix docstring
* Add LogProcessor and some unit test
* update unit test
* complete LogProcessor unit test
* refine LoggerHook
* solve circle import
* change default logger_name to mmengine
* refactor eta
* Fix docstring comment and unitt test
* Fix with runner
* fix docstring
fix docstring
* fix docstring
* Add by_epoch attribute to LoggerHook and fix docstring
* Please mypy and fix comment
* remove \ in MMLogger
* Fix lint
* roll back pre-commit-hook
* Fix hook unit test
* Fix comments
* remove \t in log and add docstring
* Fix as comment
* should not accept other arguments if corresponding instance has been created
* fix logging ddp file saving
* fix logging ddp file saving
* move log processor to logging
* move log processor to logging
* remove current datalaoder
* fix docstring
* fix unit test
* add learing rate in messagehub
* Support output training/validation/testing message after iterations/epochs
* fix docstring
* Fix IterBasedRunner log string
* Fix IterBasedRunner log string
* Support parse validation loss in log processor
* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR (#188 )
* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR
* min_lr -> eta_min, refined docstr
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Haian Huang(深度眸) <1286304229@qq.com>
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>
2022-04-26 00:37:16 +08:00
4f5c0cd273
Merge branch 'main' of github.com:open-mmlab/mmengine into adapt
2022-04-22 13:52:48 +08:00
a3b8d4ea56
Refactor docs of basedataset ( #175 )
...
* refactor docs of basedataset
* fix ci
* fix comments
* fix comments
* fix comments
* fix comments
* fix comments
* set default value of ann_file to ''
* fix comments
2022-04-22 13:51:57 +08:00
ae3b857480
Merge branch 'adapt' of github.com:open-mmlab/mmengine into adapt
2022-04-22 13:48:14 +08:00
82a313d09b
[Enhancement] Refine logging. ( #148 )
...
* rename global accessible and intergration get_sintance and create_instance
* move ManagerMixin to utils
* fix as docstring and seporate get_instance to get_instance and get_current_instance
* fix lint
* fix docstring, rename and move test_global_meta
* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume
* refine MMLogger timestamp, update unit test
* MMLogger add logger_name arguments
* Fix docstring
* change default logger_name to mmengine
* Fix docstring comment and unitt test
* fix docstring
fix docstring
* fix docstring
* Fix lint
* Fix hook unit test
* Fix comments
* should not accept other arguments if corresponding instance has been created
* fix logging ddp file saving
* fix logging ddp file saving
* fix docstring
* fix unit test
* fix docstring as comment
2022-04-21 19:12:10 +08:00
45567b1d1c
automaticaly update iter and epoch in message_hub ( #168 )
...
* automatic update iter and epoch in message_hub
* add docstring
* Update comment and docstring
* Fix as comment
* Fix docstring and comment
* refine comments
2022-04-21 11:45:03 +08:00
5f8f36e6a5
refactor visualization ( #147 )
...
* [WIP] add inline
* refactor vis module
* [Refactor] according review
* [Fix] fix comment
* fix some error
* Get sub visualizer be Visualizer.get_instance
* fix conflict
* fix lint
* fix unit test
* fix mypy
* fix comment
* fix lint
* update docstr
* update
* update instancedata
* remove replace __mro__ with issubclass
Co-authored-by: PJLAB\huanghaian <1286304229@qq.com>
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>
2022-04-15 15:56:06 +08:00
605e78be82
Haochenye/fix logging ( #167 )
...
* remove LoggerHook master_only
* remogve \t in log string
* fix lint
* Fix lint
2022-04-12 21:50:30 +08:00
6e4bcc997d
[Fix] Fix resume from checkpoint. ( #174 )
2022-04-12 21:49:31 +08:00
3d830a28b6
[Fix]: Fix is_model_wrapper and add DistSamplerSeedHook to default hooks. ( #172 )
...
* [Fix]: Fix model_wrapper and add DistSamplerSeedHook as default hook.
* add comments
2022-04-08 22:18:23 +08:00
93d22757cf
Merge branch 'main' into adapt
2022-04-08 16:02:05 +08:00
50650e0b7a
[Enhancement] Refactor the unit tests of dist module with MultiProcessTestCase ( #138 )
...
* [Enhancement] Provide MultiProcessTestCase to test distributed related modules
* remove debugging info
* add timeout property
* [Enhancement] Refactor the unit tests of dist module with MultiProcessTestCase
* minor refinement
* minor fix
2022-04-08 15:58:03 +08:00
59cc08e3ac
[Refactor] Refactor data_batch type and remove cur_dataloader in runner. ( #171 )
...
* [Refactor] Refactor data_batch type.
* fix sampler
* [Refactor] Remove cur_dataloader in runner.
* fix set_epoch
2022-04-08 15:57:10 +08:00
ab8b51682f
[Fix] Init weights after build model. ( #164 )
...
* [Fix] Init weights after build model.
* add unit tests and docstring
2022-04-05 17:44:59 +08:00
87da7599ae
Merge branch 'main' into adapt
2022-04-01 19:46:41 +08:00
2d80367893
[Refactor] Refactor Evaluator to Metric. ( #152 )
...
* [Refactor] Refactor Evaluator to Metric.
* update
* fix lint
* fix doc
* fix lint
* resolve comments
* resolve comments
* remove collect_device from evaluator
* rename
2022-04-01 15:06:38 +08:00
2fdca03f19
[Enhancement] Support get sub dataset and rename method and variable. ( #145 )
...
* add get_subset method, add comment, rename variable
* add unit test
* Please mypy
* Fix as comment, support negative index, and fix index access error
* add and refine docstring, handle indices=0
* handle indices=0
* add empty list indices test
* rename in_meta in docstring and comments to in_metainfo
* clean meta nameing
* Fix negative indices error
* test empty list of get_subset
* fix comments and docstring
* add unit test
* Fix as comment
* Fix as comment
* add docstring to mention wrapped dataset should not inherit from Basedataset
* Fix wrapped dataset docstring
* Fix wrapped dataset docstring
* Fix method name, docstring, and comments
* Fix comments
* Fix comments
* Fix comments
2022-04-01 14:51:11 +08:00
a39d959eeb
Merge branch 'main' into adapt
2022-04-01 13:08:39 +08:00
0ca54eb71b
[Fix] Fix unit tests when gpu is not available ( #163 )
2022-04-01 12:50:15 +08:00
25014af3c3
[Refactor] Refactor default_scope in Registry. ( #158 )
2022-04-01 09:13:55 +08:00
dc594e75bf
[Feature] Add InstanceData ( #160 )
...
* [Enhancement] refactor base data elment
* fix comment
* fix comment
* fix pop not existing key without error
* add instance_data
* update
* refine code
* add refer
Co-authored-by: liukuikun <641417025@qq.com>
2022-03-31 23:30:00 +08:00
e80267ae06
[Fix] Fix unit tests of evaluator ( #162 )
2022-03-31 23:25:50 +08:00
7e246b6f65
[Enhancement] refactor base data element ( #143 )
...
* [Enhancement] refactor base data elment
* fix comment
* fix comment
* fix pop not existing key without error
2022-03-31 18:21:45 +08:00
f1de071cf0
[Enhancement] Refactor Runner ( #139 )
...
* [Enhancement] Rename build_from_cfg to from_cfg
* refactor build_logger and build_message_hub
* remove time.sleep from unit tests
* minor fix
* move set_randomness from setup_env
* improve docstring
* refine comments
* print a warning information
* refine comments
* simplify the interface of build_logger
2022-03-30 14:26:40 +08:00
9a61b389e7
[Refactor] Add batch_idx to hook input. ( #140 )
...
* [Refactor] Add batch_idx to hook input.
* update
2022-03-29 11:40:38 +08:00
563b4bad16
[Feature] add defaut scope ( #149 )
...
* add defaut scope
* Fix docstring
* override get_current_instance method in DefaultScope
clean meta nameing
* remove default mmengine argument of DefaltScope
remove default mmengine argument of DefaltScope
remove default mmengine argument of DefaltScope
* Fix unit test
Fix unit test
* Fix example in docstring
* add explaination of DefaultScope
2022-03-28 23:14:41 +08:00
1048584147
[Enhancement] Refine GlobalAccessble ( #144 )
...
* rename global accessible and intergration get_sintance and create_instance
* move ManagerMixin to utils
* fix as docstring and seporate get_instance to get_instance and get_current_instance
* fix lint
* fix docstring, rename and move test_global_meta
* fix manager's runtime error description
fix manager's runtime error description
* Add comments
* Add comments
2022-03-26 21:21:25 +08:00
26f24296db
[Feature]: Add dist semantics in checkpoint hook ( #131 )
...
* [Feature]: Add dist semantics in checkpoint hook
* [Fix]: Delete sync buffer in checkpoint hook
2022-03-25 13:46:31 +08:00
248ad9aee8
[Feature] Add Runner and Loop ( #86 )
...
* [Feature] Add Runner and Loop
* refine docstring
* refine docstring
* refine __init__ of Runner
* add Runner.save_checkpoint
* add comment for data_batch
* rename validation_cfg to val_cfg
* update branch
* update branch
* discard wear reference
* set seed for torch in dataloader worker
* refine comments
* reorder methods
* import module in __init__.py
* add runner.load_checkpoint
* rename attributes
* fix indent
* fix indent
* add comment for LOOPS
* add example for methods
* add example for methods
* refine examples
* add Runner.resume and refactor register_hooks
* remove type hint of runner in CheckpointHook
* rename before_run to before_train
* remove collate
* add before_run after_run for loop.run
* dummy collate_fn
* add more unit tests
* move call_hook('before_run') to runner
* minor fix
* add comments for collate_fn
* fix type hint
* refactor logic to load or resume checkpoint
* fix typo
* add comments for IterBasedTrainLoop
* refactor unit tests
* fix unit tests
* refactor
* fix setup_env
* refine
* minor fix
* Merge branch 'main' of github.com:open-mmlab/mmengine into zzd/add-runner
* minor fix
* minor fix
* refine
* refactor unit tests
* fix unit tests
* add launcher property
* add logger, message_hub and writer unit tests
* add cur_dataloader attribute for runner
* fix IterBasedTrainLoop
* add torch.no_grad decorator
* add master_only decorator for save_checkpoint
* add before_test_epoch in TestLoop
* refactor load_or_resume method
* refine docstring
* fix typo
* build_dataloader can handle dataset object
* add dump_config for runner
* collate_fn should not a lambda function
* minor fix
* refine docstring
* fix unit tests
* improve comments
* refine unit tests
* rename collate_fn to pseduo_collate
* add 'TODO' tag
2022-03-14 13:19:29 +08:00
b3d54481fd
[Fix] Fallback to use self registry if default_scope not found ( #122 )
2022-03-14 00:44:16 +08:00
fff4742e0b
[Enhancement] Messagehub supports update dict logs. ( #120 )
...
* Messagehub support update dict values
* Messagehub support update dict values
* fix assertion error message
2022-03-13 21:28:47 +08:00
f548c81846
[Enhancement] Handle tensor device type in sync_random_seed ( #126 )
2022-03-13 17:45:02 +08:00
a7961407e4
[Refactor] Refactor the interfaces of Hook and its subclassed ( #117 )
...
* Fix hook
* Fix
* Fix docs
* FIx
* Fix
* Fix as comment
* update
* Fix hook
* Fix hook
* Fix hook
* Fix itertimerhook
* Fix iter_timer_hook
* Fix
* Fix
* fix logger hook
* Fix loggerhook
* update cur_dataloader
* Fix docstring
* Fix docstring
* Fix as commet
* Fix as commet
* Fix as comment
* rename is_last_epoch, enhance and add after_val before_val .etc
* fix typo in docstring
* remove resolved TODO
* refactor docstring
2022-03-13 16:48:09 +08:00
755f8b5b59
[Refactor]: Change scheduler to param_scheduler ( #121 )
...
* [Refactor]: Change scheduler to param_scheduler
* [Fix]: Fix UT of param scheduler hook
Co-authored-by: Your <you@example.com>
2022-03-12 10:47:06 +08:00
61fecabea6
[Feature] Update evaluator prefix ( #114 )
...
* update evaluator prefix
* update docstring and comments
* update doc
2022-03-10 17:25:20 +08:00
3e0c064f49
[Feature] NaiveVisualizationHook ( #98 )
...
* [WIP] testvisualizationhook
* add TestNaiveVisualizationHook
* fix comment
* unpad
* batch imdenormalize
* fix comment
* fix comment
2022-03-10 17:22:31 +08:00
02ceaedb82
[Enhancement] Config support deep copy ( #116 )
...
* Config support deep copy
* Fix end of line
2022-03-10 16:01:18 +08:00
2e4ae21f2b
Fix test_get_max_memory ( #113 )
2022-03-09 14:05:25 +08:00
c499d72691
fix evaluator unit test ( #112 )
2022-03-08 20:07:32 +08:00
6f69039ca9
[Feature] Add LoggerHook ( #77 )
...
* add logger hook
* update
* update
* update test
* update
* update test
* update
* update
* update
* update
* update
* Add logger hook
* Fix pre-commit
* Fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
* Fix bytes
* update
* Fix as comment
* Fix as comment
* Update runner
* Fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
2022-03-08 16:10:30 +08:00
49b7d0ce6f
Support default_scope when building optimizer and evaluator. ( #109 )
...
* Support default_scope when building optimizer and evaluator.
* add docstring
* fix
* fix
2022-03-08 16:05:29 +08:00
be6f18988e
Update type hint and unit tests of evaluator. ( #110 )
...
* update type hint and ut for evaluator
* update doc
* fix
2022-03-08 16:04:46 +08:00
cfccabc657
[Feature] Support metric prefix in BaseEvaluator ( #82 )
...
* support metric prefix in BaseEvaluator
* update docs
* use class attribute default_prefix
2022-03-08 15:12:11 +08:00
824be950b9
Add writer ( #74 )
...
* add writer
* update
* update
* update docstr
* update unittest
* update unittest
* fix comment
* update unittest
* fix comment
* fix comment
* fix comment
* fix comment
* update
2022-03-07 22:39:25 +08:00
7acaca1445
Visualizer ( #67 )
...
* [WIP] Visualizer
* add draw featmap
* update docstring
* update docstring
* update docstring
* fix comment
* fix comment
* fix comment
* fix comment
* fix comment
2022-03-07 22:06:32 +08:00
be9971781e
[Fix]: Change the type of runner in docstring to Runner ( #103 )
...
* [Fix]: Change after inter and epoch to after train iter and epoch
* [Fix]: Add new UT to param scheduler hook
* [Fix]: Change the type of runner in docstring to Runner
Co-authored-by: Your <you@example.com>
2022-03-07 14:00:05 +08:00
3adf4ea6b8
[Fix] data element ( #95 )
2022-03-06 22:06:12 +08:00
2d782b4998
[Feature] add logging UT and impl ( #43 )
...
* first commit
* update logging
* update MessageHub unit test and LogBuffer unitest
* update logging docs
* update logging impl and test
* update test logging
* update test
* update logging test and impl
* Fix logging test
* Update log_buffer.py
* rename statistics argumentes
* fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
* Fix meta class
* Fix as comment
* Fix as comment
* Fix as comment
* Fix name declare
* Fix as comment
* Fix as comment
* Fix as comment
* Fix docstring
* Fix as comment
* Fix as comment
2022-03-06 17:09:12 +08:00
c6a8d72c5e
[Feature] Add distributed module ( #59 )
...
* [Feature] Add distributed module
* fix IS_DIST error
* all_reduce_dict does operations in-place
* support 'mean' operation
* provide local group process
* add tmpdir argument for collect_results
* add unit tests
* refactor unit tests
* simplify steps to create multiple processes
* minor fix
* describe the different of *gather* in mmengine and pytorch
* minor fix
* add unit tests for nccl
* test nccl backend in multiple gpu
* add get_default_group function to handle different torch versions
* minor fix
* [Feature] Add distributed module
* fix IS_DIST error
* all_reduce_dict does operations in-place
* support 'mean' operation
* provide local group process
* add tmpdir argument for collect_results
* add unit tests
* refactor unit tests
* simplify steps to create multiple processes
* minor fix
* describe the different of *gather* in mmengine and pytorch
* minor fix
* add unit tests for nccl
* test nccl backend in multiple gpu
* add get_default_group function to handle different torch versions
* minor fix
* minor fix
* handle torch1.5
* handle torch1.5
* minor fix
* fix typo
* refactor unit tests
* nccl does not support gather and gather_object
* fix gather
* fix collect_results_cpu
* fix collect_results and refactor unit tests
* fix collect_results unit tests
* handle torch.cat in torch1.5
* refine docstring
* refine docstring
* fix comments
* fix comments
2022-03-05 22:03:32 +08:00
11b38b12d6
[Fix] fix random may generate same value ( #85 )
2022-03-05 15:02:54 +08:00
64b1d183b9
Add runner unit tests. ( #68 )
...
* add runner unit tests
* update
* update
* add test custom loop and hook
* add test model wrapper
* add test setup env
* fix typo
* fix launcher
* fix typo
* test default scope
* add logger test
* fix dataloader
* add test loop
* resolve comments
* resolve comments
2022-03-03 19:44:36 +08:00
149248ce52
[Feature] Add Sync Buffer Hook ( #57 )
...
* [Feature]: Add Part3 of Hooks
* [Feature]: Add Hook
* [Fix]: Add docstring and type hint for base hook
* add sync buffer hook
* update typing hint and docs
* fix lint
* fix mypy
* fix lint
* use mock from unittest
Co-authored-by: seuyou <3463423099@qq.com>
2022-03-03 17:13:43 +08:00
12b916cf6f
[Feature] add base global access ( #72 )
...
* add impl
* add test
* Fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
2022-03-02 23:38:04 +08:00
cf239a2b17
[Feature]: Add checkpoint hook ( #66 )
...
* [Feature]: Add checkpoint hook
* [Fix]: Fix lint
* [Fix]: Delete redundant optional and give an example to our_dir
* [Feature]: Add test the last_ckpt in UT
* [Fix]: Fix docstring problem
* [Fix]: Add patch to UT
* [Feature]: Add Test case for by epoch
2022-03-02 22:01:58 +08:00
2448380339
use unittest mock ( #71 )
2022-03-02 21:53:40 +08:00
94ab45d07e
[Feature] Add empty cache hook ( #58 )
...
* [Feature]: Add Part3 of Hooks
* [Feature]: Add Hook
* [Fix]: Add docstring and type hint for base hook
* [Fix]: Add test case to not the last iter, inner_iter, epoch
* [Fix]: Add missing type hint
* [Feature]: Add Args and Returns in docstring
* [Fix]: Add missing colon
* [Fix]: Add optional to docstring
* [Fix]: Fix docstring problem
* [Fix]: Fix lint
* fix lint
* update typing and docs
* fix lint
* Update mmengine/hooks/empty_cache_hook.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/hooks/empty_cache_hook.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/hooks/empty_cache_hook.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update tests/test_hook/test_empty_cache_hook.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* fix lint
* fix comments
* remove test condition
Co-authored-by: seuyou <3463423099@qq.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-03-02 14:04:41 +08:00
63a3af4f8c
[Feature]: Add optimizer hook ( #70 )
...
* [Feature]: Add optimizer hook
* [Fix]: Update docstring
* [Fix]: Add call with in UT
2022-03-01 17:42:15 +08:00
ab31e1936e
[Feature]: Add param scheduler hook ( #63 )
...
* [Feature]: Add param scheduler hook
* [Fix]: update docstring and add assert_call to UT
2022-03-01 15:49:44 +08:00
2d3e91248c
[Feature]: Add sampler seed hook ( #64 )
...
* [Feature]: Add sampler seed hook
* [Fix]: Add call with to UT
2022-03-01 15:38:01 +08:00
1244e486ae
[Feature] Add Iter Timer Hook ( #48 )
...
* [Feature]: Add Part3 of Hooks
* [Feature]: Add Hook
* add iter timer hook
* update test
* [Fix]: Add docstring and type hint for base hook
* fix mypy
* improve doc coverage and merge main
Co-authored-by: seuyou <3463423099@qq.com>
2022-03-01 12:02:34 +08:00
42448425b3
[Feature] Add evaluator unittest ( #46 )
...
* add evaluator unittest
* update composed evaluator cfg
* add building function
* resolve comments
* resolve comments
* resolve comments
* fix evaluator doc
2022-03-01 12:00:19 +08:00
c2c5664fad
Fix pt1.5 unit tests. ( #65 )
...
* Fix pt1.5 unit tests.
* move to mmengine.testing
2022-03-01 11:28:21 +08:00
5170676a2f
fix mmdp unittest ( #60 )
2022-02-27 20:34:52 +08:00
bc759e5550
[Feature]: Add base Hook ( #47 )
...
* [Feature]: Add Part3 of Hooks
* [Feature]: Add Hook
* [Fix]: Add docstring and type hint for base hook
* [Fix]: Add test case to not the last iter, inner_iter, epoch
* [Fix]: Add missing type hint
* [Feature]: Add Args and Returns in docstring
* [Fix]: Add missing colon
* [Fix]: Add optional to docstring
* [Fix]: Fix docstring problem
* [Fix]:typo
* [Fix]: Fix lint
Co-authored-by: Your <you@example.com>
2022-02-26 14:51:09 +08:00
492b2f2fa8
[Feature] Add MMDataParallel and MMDistributedDataParallel ( #44 )
...
* add mmddp
* update
* update code
* update unittest
* fix comment
2022-02-26 10:21:20 +08:00
1e79b97444
Mock unimplemented modules and fix unit tests ( #54 )
...
* Mock unimplemented modules and fix unit tests
* add a comment
2022-02-25 15:24:27 +08:00
9437ebea67
[Feat]: Add abstract data structure ( #29 )
...
* [WIP] abstract-data-structure
* update docs
* update
* update BaseDataSample
* fix comment and coverage 100%
* update and add _set_field
* update
* split into base_data_element and base_data_sample
* update
* update
* update
* fix typo
2022-02-22 21:45:32 +08:00
ada6660c65
[Feature] add base dataset ( #32 )
...
* basedataset first commit
* add base dataset
* add dataset
* add basedataset
* Fix test dataset
* Fix mypy and test
* Fix mypy and test
* remove unused code
* Update mmengine/dataset/base_dataset.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/dataset/base_dataset.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* add more corner cases in unittest
* fix lint
* Fix as comment
* Fix lint
* update unitest
* Type hint Dick to dict
* rename max_refetch
* Fix as comment
* Fix typo
* Fix as comment
* BaseDataset is no more an abstrac Class, change UT and docs
* Fix as comment
* Fix as comment and refactor type error
* Add comment for full init
* Fix as comment and modify dataset_wrapper
* Fix as comment and modify dataset_wrapper
* Fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
* Fix as comment
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Tao Gong <gongtao950513@gmail.com>
2022-02-22 14:01:06 +08:00
adb2aee8c2
[Unittest] Add visualizer unittest ( #27 )
...
* add visualizer unittest
* update
* fix comment
* fix commit
* fix comment
* fix comment
2022-02-21 20:55:11 +08:00
f0451a38f0
[Feature] Add data sampler ( #30 )
...
* Add DefaultSampler and InfiniteSampler
* Add unit test
* Add samplers to API reference
* Update docstring
* Improve according to comments
* Rename `num_replicas` to `world_size`
* Update docstring.
* Update mmengine/data/sampler.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/data/sampler.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Fix typo in unit test
Co-authored-by: Wenwei Zhang <40779233+ZwwWayne@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-02-21 13:08:55 +08:00
7353778b7c
[Feature]: Add optimzier and constructor. ( #25 )
...
* [Feature]: Add optimzier and constructor.
* refactor unit tests
* add optimizer doc
* add parrots wrapper
* add parrots wrapper
* solve comments
* resolve comments
2022-02-19 14:09:37 +08:00
b8e7c8ee8f
Fix test_auto_argparse when pytest has multiple arguments ( #34 )
2022-02-19 12:22:15 +08:00
6bd813c8ba
[Feature] Add Config ( #24 )
...
* add config test
* Fix typo
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update tests/config/test_config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Reconstruct config test
* Fix import logic and error test
* Fix path error
* Restructuring Config
* simplify test logic
simplify test logic
* add config
* [Feature] Add Config
* fix lint
* remove test_config
* cancel change to pre-commit yaml
* solve conflict
* fix comments
* merge main
* fix lint
* update
* remove some magic docs
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* add deprecation test
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmengine/config/config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* update
* fix mypy
* fix lint
* fix super
* improve ut coverage
* add test dump
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>
Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-02-17 22:33:21 +08:00
8751231103
add config test ( #10 )
...
* add config test
* Fix typo
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update tests/config/test_config.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Reconstruct config test
* Fix import logic and error test
* Fix path error
* Restructuring Config
* simplify test logic
simplify test logic
* rename test_config file
* add test complex dump and pretty text
* adjust test sequence according to comment
adjust test sequence according to comment
* add comment and test for simple.config.py
* add config test data
* add init
* remove __pycache__
* fix as comment
* add syntax test case
* remove tmp path and modify comment
* add test for setattr
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-02-17 17:46:06 +08:00
7905f039b6
[Feature]: Add parameter schedulers. ( #22 )
...
* [Feature]: Add parameter schedulers.
* update
* update
* update
* update
* add docstring to lr and momentum
* resolve comments
2022-02-16 23:43:59 +08:00
41e1191cbc
add unit tests of data abstract interface ( #21 )
...
* add unit tests of data abstract interface
* update
* update
* update docs of data element
* a draft of UT of datasample, to be finished
* update datasample test
* updata
* update
* fix comments
* fix comments
* fix comments
Co-authored-by: liukuikun <liukuikun@sensetime.com>
2022-02-16 23:19:18 +08:00
bbb7d625e6
add scheduler unit test ( #13 )
...
* tmp
* add scheduler unit test
* disable yapf
* add more test
* add more test
* not use torch test case
* solve comments
* update file
* add more unit tests
* resolve comments
* update cosine ut
* fix typo
* solve comments
* solve comments
* resolve comments
2022-02-16 22:33:46 +08:00
cccd20a636
[Feature] Add Registry ( #11 )
2022-02-16 21:45:39 +08:00
166ca02363
[Refactor] Move fileio directory from utils ( #23 )
...
* move fileio directory from utils
* remove CephBackend from fileio and clear some deprecated docstring
* fix format
* fix a spellling error
2022-02-15 23:43:20 +08:00
100ede73e6
Add unittest for BaseDataset ( #15 )
...
* tmp commit
* add unittest for basedataset
* fix lint
* resolve all comments
* update
* update
* update
* update
* update
* update
* update
* resolve comments
* resolve comments
* update
* resolve comments
* resolve comments
2022-02-15 20:17:47 +08:00
6ba7ac3a8e
Add the unittest of registry ( #5 )
...
* Add the unittest of registry
* improve the format
* fix the test_repr
* refactor the test_init
* add the copyright for tests directory
* add more unit tests
* fix error
* add unit tests for _search_child and _get_root_registry
* build_from_cfg supports dict, ConfictDict and Config
* improve docstring
2022-02-15 15:37:53 +08:00
Mashiro
RangiLyu
Miao Zheng
Tong Gao
Ma Zerun
Cedric Luo
LeoXing1996
Jiazhen Wang
Yuan Liu
Alex Yang
Haian Huang(深度眸)
liukuikun
jbwang1997
Zaida Zhou
Jingwei Zhang
Wenwei Zhang
ZwwWayne
Tao Gong
Yining Li
Yifei Yang