liukuikun
689837d2b8
[Enhancement] add pixel data and label data ( #224 )
2022-05-13 18:23:25 +08:00
RangiLyu
1912660db9
[Feature] Support convert epoch-based schedulers to iter-based. ( #221 )
...
* [Feature] Support convert epoch-based schedulers to iter-based.
* Support convert and refactor LR and Momentum to mixin.
* Add unit tests
* fix args and add runner ut
* resolve comments
2022-05-10 15:17:51 +08:00
Mashiro
9087956f70
[Enhance] Update config with newest mmcv and show custom imports error explicitly ( #192 )
...
* add import error information
* Update config with newest mmcv
* add empty line to test config
2022-05-06 22:59:54 +08:00
Mashiro
859f4d1580
[Fix] Fix some code and docstring in LogProcessor and LoggerHook ( #213 )
...
* fix logger hook
* fix to record multi-level logs, log train/a/b to a/b
* fix loggerhook json path
* fix uunit test
* change runner.train_dataloader to runner.train_loop.dataloader
* clean debug code
* refie comments and docstring
* fix unit test
2022-05-06 14:33:33 +08:00
liukuikun
5c5c03e648
[Enchance] cat empty instancedata, support torch.bool for more type ( #209 )
...
* refactor instancedata
* fix docs
* fix comment
2022-05-06 14:00:51 +08:00
Zaida Zhou
16058fdb18
[Fix] Fix RecursionError when key is invalid ( #220 )
...
* [Fix] Fix RecursionError when key is invalid
* refine comments
2022-05-05 20:09:03 +08:00
Mashiro
5007825619
[Fix] change CheckPointHook before_run to before train ( #214 )
...
* change CheckPointHook before_run to before train
* using tmp_path in each checkpointhook test case
2022-05-05 20:08:07 +08:00
RangiLyu
4742544b25
[Feature] Support collect all registered module info. ( #193 )
...
* [Feature] Support collect all registered module info.
* update
* update
* add unit tests
* add to runner
* resolve comments
2022-05-05 11:59:51 +08:00
RangiLyu
29342c4eb2
[Fix] Fix to_dict in BaseDataElement and add metainfo property. ( #215 )
...
* [Fix] Fix to_dict in BaseDataElement and add metainfo property.
* Update mmengine/data/base_data_element.py
Co-authored-by: liukuikun <24622904+Harold-lkk@users.noreply.github.com>
Co-authored-by: liukuikun <24622904+Harold-lkk@users.noreply.github.com>
2022-04-29 10:19:19 +08:00
Mashiro
05fd5e81a3
[Enhance] Refine MMLogger and change save dir of MMLogger and Visualizer ( #205 )
...
* MMLogger can call get_current_instance without get_instance, change log path
* fix docstring
* fix docstring and update UT
* Fix runner
* fix docstring and lint
* fix ut below python3.8
* resolve circle import
2022-04-27 20:47:14 +08:00
Mashiro
db2b45b7ac
[Fix] Fix the probable failure of the basedataset unit test ( #210 )
2022-04-27 19:48:28 +08:00
Zaida Zhou
17dbac1812
[Enhancement] Handle the device type of inputs in functions ( #137 )
...
* [Enhancement] Handle the device type of inputs in functions
* rename and move three fucntions to dist/utils.py
* minor refinement
* rename dist to torch_dist in utils.py
* update unit tests
* refine unit tests
* add unit tests
* fix unit tests
* replace Sequence with list and tuple
* rename get_backend_device to get_comm_device
* fix unit tests
* fix unit tests
* refactor and add more unit tests
* cast_data_device does not support set type
2022-04-27 19:46:13 +08:00
Zaida Zhou
661e759063
[Fix] param_scheduler can not None when training models ( #208 )
...
* [Fix] param_scheduler can not None when training models
* update unit tests
* fix unit tests
* refactor ParamSchedulerHook
* refactor unit tests
* param_schedulers can be an empty list
2022-04-27 19:45:27 +08:00
Haian Huang(深度眸)
6996bdc892
Update visualizer code ( #184 )
...
* update vis backend
* update vis backend
* update vis backend
* update visualizer
* update visualizer
* update visualizer
* update featmap
* update featmap
* update visualizer and unitest
* add draw points unitest and refactor vis_backend
* fix typo and close unitest
* fix comment
* add docstring
* fix comment
* add master only
* fix comment
Co-authored-by: liukuikun <641417025@qq.com>
2022-04-27 19:44:40 +08:00
Mashiro
452b3656a1
[Fix] Fix dump config without self.filename ( #202 )
...
* fix config
* add docstring and unit test
* update tutorial
* update tutorial
* fix markdown format
* fix markdown format
2022-04-27 19:43:12 +08:00
Mashiro
4dcbd269aa
[Enhance] register dataset wrapper ( #185 )
...
* register dataset wrapper
* fix as comment
2022-04-26 16:52:13 +08:00
Wenwei Zhang
96f3d97fc4
Try to fix lint issue ( #199 )
...
* try to fix lint
* upgrade yapf version
* use another way to bypass yapf
* update docstring
2022-04-26 13:53:00 +08:00
Mashiro
e0d00c5bdd
[Fix] resolve conflict betweem adapt and main. ( #198 )
...
* [Docs] Refine registry documentation (#186 )
* [Docs] Refine registry documentation
* reslove comments
* minor refinement
* Refine Visualizer docs (#177 )
* Refine Visualizer docs
* update
* update
* update featmap
* update docs
* update visualizer docs
* [Refactor] Refine LoggerHook (#155 )
* rename global accessible and intergration get_sintance and create_instance
* move ManagerMixin to utils
* fix as docstring and seporate get_instance to get_instance and get_current_instance
* fix lint
* fix docstring, rename and move test_global_meta
* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume
* refine MMLogger timestamp, update unit test
* MMLogger add logger_name arguments
* Fix docstring
* Add LogProcessor and some unit test
* update unit test
* complete LogProcessor unit test
* refine LoggerHook
* solve circle import
* change default logger_name to mmengine
* refactor eta
* Fix docstring comment and unitt test
* Fix with runner
* fix docstring
fix docstring
* fix docstring
* Add by_epoch attribute to LoggerHook and fix docstring
* Please mypy and fix comment
* remove \ in MMLogger
* Fix lint
* roll back pre-commit-hook
* Fix hook unit test
* Fix comments
* remove \t in log and add docstring
* Fix as comment
* should not accept other arguments if corresponding instance has been created
* fix logging ddp file saving
* fix logging ddp file saving
* move log processor to logging
* move log processor to logging
* remove current datalaoder
* fix docstring
* fix unit test
* add learing rate in messagehub
* Support output training/validation/testing message after iterations/epochs
* fix docstring
* Fix IterBasedRunner log string
* Fix IterBasedRunner log string
* Support parse validation loss in log processor
* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR (#188 )
* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR
* min_lr -> eta_min, refined docstr
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Haian Huang(深度眸) <1286304229@qq.com>
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>
2022-04-26 00:37:16 +08:00
ZwwWayne
4f5c0cd273
Merge branch 'main' of github.com:open-mmlab/mmengine into adapt
2022-04-22 13:52:48 +08:00
Tao Gong
a3b8d4ea56
Refactor docs of basedataset ( #175 )
...
* refactor docs of basedataset
* fix ci
* fix comments
* fix comments
* fix comments
* fix comments
* fix comments
* set default value of ann_file to ''
* fix comments
2022-04-22 13:51:57 +08:00
ZwwWayne
ae3b857480
Merge branch 'adapt' of github.com:open-mmlab/mmengine into adapt
2022-04-22 13:48:14 +08:00
Mashiro
82a313d09b
[Enhancement] Refine logging. ( #148 )
...
* rename global accessible and intergration get_sintance and create_instance
* move ManagerMixin to utils
* fix as docstring and seporate get_instance to get_instance and get_current_instance
* fix lint
* fix docstring, rename and move test_global_meta
* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume
* refine MMLogger timestamp, update unit test
* MMLogger add logger_name arguments
* Fix docstring
* change default logger_name to mmengine
* Fix docstring comment and unitt test
* fix docstring
fix docstring
* fix docstring
* Fix lint
* Fix hook unit test
* Fix comments
* should not accept other arguments if corresponding instance has been created
* fix logging ddp file saving
* fix logging ddp file saving
* fix docstring
* fix unit test
* fix docstring as comment
2022-04-21 19:12:10 +08:00
Mashiro
45567b1d1c
automaticaly update iter and epoch in message_hub ( #168 )
...
* automatic update iter and epoch in message_hub
* add docstring
* Update comment and docstring
* Fix as comment
* Fix docstring and comment
* refine comments
2022-04-21 11:45:03 +08:00
liukuikun
5f8f36e6a5
refactor visualization ( #147 )
...
* [WIP] add inline
* refactor vis module
* [Refactor] according review
* [Fix] fix comment
* fix some error
* Get sub visualizer be Visualizer.get_instance
* fix conflict
* fix lint
* fix unit test
* fix mypy
* fix comment
* fix lint
* update docstr
* update
* update instancedata
* remove replace __mro__ with issubclass
Co-authored-by: PJLAB\huanghaian <1286304229@qq.com>
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>
2022-04-15 15:56:06 +08:00
Mashiro
605e78be82
Haochenye/fix logging ( #167 )
...
* remove LoggerHook master_only
* remogve \t in log string
* fix lint
* Fix lint
2022-04-12 21:50:30 +08:00
RangiLyu
6e4bcc997d
[Fix] Fix resume from checkpoint. ( #174 )
2022-04-12 21:49:31 +08:00
RangiLyu
3d830a28b6
[Fix]: Fix is_model_wrapper and add DistSamplerSeedHook to default hooks. ( #172 )
...
* [Fix]: Fix model_wrapper and add DistSamplerSeedHook as default hook.
* add comments
2022-04-08 22:18:23 +08:00
ZwwWayne
93d22757cf
Merge branch 'main' into adapt
2022-04-08 16:02:05 +08:00
Zaida Zhou
50650e0b7a
[Enhancement] Refactor the unit tests of dist module with MultiProcessTestCase ( #138 )
...
* [Enhancement] Provide MultiProcessTestCase to test distributed related modules
* remove debugging info
* add timeout property
* [Enhancement] Refactor the unit tests of dist module with MultiProcessTestCase
* minor refinement
* minor fix
2022-04-08 15:58:03 +08:00
RangiLyu
59cc08e3ac
[Refactor] Refactor data_batch type and remove cur_dataloader in runner. ( #171 )
...
* [Refactor] Refactor data_batch type.
* fix sampler
* [Refactor] Remove cur_dataloader in runner.
* fix set_epoch
2022-04-08 15:57:10 +08:00
RangiLyu
ab8b51682f
[Fix] Init weights after build model. ( #164 )
...
* [Fix] Init weights after build model.
* add unit tests and docstring
2022-04-05 17:44:59 +08:00
ZwwWayne
87da7599ae
Merge branch 'main' into adapt
2022-04-01 19:46:41 +08:00
RangiLyu
2d80367893
[Refactor] Refactor Evaluator to Metric. ( #152 )
...
* [Refactor] Refactor Evaluator to Metric.
* update
* fix lint
* fix doc
* fix lint
* resolve comments
* resolve comments
* remove collect_device from evaluator
* rename
2022-04-01 15:06:38 +08:00
Mashiro
2fdca03f19
[Enhancement] Support get sub dataset and rename method and variable. ( #145 )
...
* add get_subset method, add comment, rename variable
* add unit test
* Please mypy
* Fix as comment, support negative index, and fix index access error
* add and refine docstring, handle indices=0
* handle indices=0
* add empty list indices test
* rename in_meta in docstring and comments to in_metainfo
* clean meta nameing
* Fix negative indices error
* test empty list of get_subset
* fix comments and docstring
* add unit test
* Fix as comment
* Fix as comment
* add docstring to mention wrapped dataset should not inherit from Basedataset
* Fix wrapped dataset docstring
* Fix wrapped dataset docstring
* Fix method name, docstring, and comments
* Fix comments
* Fix comments
* Fix comments
2022-04-01 14:51:11 +08:00
ZwwWayne
a39d959eeb
Merge branch 'main' into adapt
2022-04-01 13:08:39 +08:00
Zaida Zhou
0ca54eb71b
[Fix] Fix unit tests when gpu is not available ( #163 )
2022-04-01 12:50:15 +08:00
RangiLyu
25014af3c3
[Refactor] Refactor default_scope in Registry. ( #158 )
2022-04-01 09:13:55 +08:00
Haian Huang(深度眸)
dc594e75bf
[Feature] Add InstanceData ( #160 )
...
* [Enhancement] refactor base data elment
* fix comment
* fix comment
* fix pop not existing key without error
* add instance_data
* update
* refine code
* add refer
Co-authored-by: liukuikun <641417025@qq.com>
2022-03-31 23:30:00 +08:00
Zaida Zhou
e80267ae06
[Fix] Fix unit tests of evaluator ( #162 )
2022-03-31 23:25:50 +08:00
liukuikun
7e246b6f65
[Enhancement] refactor base data element ( #143 )
...
* [Enhancement] refactor base data elment
* fix comment
* fix comment
* fix pop not existing key without error
2022-03-31 18:21:45 +08:00
Zaida Zhou
f1de071cf0
[Enhancement] Refactor Runner ( #139 )
...
* [Enhancement] Rename build_from_cfg to from_cfg
* refactor build_logger and build_message_hub
* remove time.sleep from unit tests
* minor fix
* move set_randomness from setup_env
* improve docstring
* refine comments
* print a warning information
* refine comments
* simplify the interface of build_logger
2022-03-30 14:26:40 +08:00
RangiLyu
9a61b389e7
[Refactor] Add batch_idx to hook input. ( #140 )
...
* [Refactor] Add batch_idx to hook input.
* update
2022-03-29 11:40:38 +08:00
Mashiro
563b4bad16
[Feature] add defaut scope ( #149 )
...
* add defaut scope
* Fix docstring
* override get_current_instance method in DefaultScope
clean meta nameing
* remove default mmengine argument of DefaltScope
remove default mmengine argument of DefaltScope
remove default mmengine argument of DefaltScope
* Fix unit test
Fix unit test
* Fix example in docstring
* add explaination of DefaultScope
2022-03-28 23:14:41 +08:00
Mashiro
1048584147
[Enhancement] Refine GlobalAccessble ( #144 )
...
* rename global accessible and intergration get_sintance and create_instance
* move ManagerMixin to utils
* fix as docstring and seporate get_instance to get_instance and get_current_instance
* fix lint
* fix docstring, rename and move test_global_meta
* fix manager's runtime error description
fix manager's runtime error description
* Add comments
* Add comments
2022-03-26 21:21:25 +08:00
Yuan Liu
26f24296db
[Feature]: Add dist semantics in checkpoint hook ( #131 )
...
* [Feature]: Add dist semantics in checkpoint hook
* [Fix]: Delete sync buffer in checkpoint hook
2022-03-25 13:46:31 +08:00
Zaida Zhou
248ad9aee8
[Feature] Add Runner and Loop ( #86 )
...
* [Feature] Add Runner and Loop
* refine docstring
* refine docstring
* refine __init__ of Runner
* add Runner.save_checkpoint
* add comment for data_batch
* rename validation_cfg to val_cfg
* update branch
* update branch
* discard wear reference
* set seed for torch in dataloader worker
* refine comments
* reorder methods
* import module in __init__.py
* add runner.load_checkpoint
* rename attributes
* fix indent
* fix indent
* add comment for LOOPS
* add example for methods
* add example for methods
* refine examples
* add Runner.resume and refactor register_hooks
* remove type hint of runner in CheckpointHook
* rename before_run to before_train
* remove collate
* add before_run after_run for loop.run
* dummy collate_fn
* add more unit tests
* move call_hook('before_run') to runner
* minor fix
* add comments for collate_fn
* fix type hint
* refactor logic to load or resume checkpoint
* fix typo
* add comments for IterBasedTrainLoop
* refactor unit tests
* fix unit tests
* refactor
* fix setup_env
* refine
* minor fix
* Merge branch 'main' of github.com:open-mmlab/mmengine into zzd/add-runner
* minor fix
* minor fix
* refine
* refactor unit tests
* fix unit tests
* add launcher property
* add logger, message_hub and writer unit tests
* add cur_dataloader attribute for runner
* fix IterBasedTrainLoop
* add torch.no_grad decorator
* add master_only decorator for save_checkpoint
* add before_test_epoch in TestLoop
* refactor load_or_resume method
* refine docstring
* fix typo
* build_dataloader can handle dataset object
* add dump_config for runner
* collate_fn should not a lambda function
* minor fix
* refine docstring
* fix unit tests
* improve comments
* refine unit tests
* rename collate_fn to pseduo_collate
* add 'TODO' tag
2022-03-14 13:19:29 +08:00
Zaida Zhou
b3d54481fd
[Fix] Fallback to use self registry if default_scope not found ( #122 )
2022-03-14 00:44:16 +08:00
Mashiro
fff4742e0b
[Enhancement] Messagehub supports update dict logs. ( #120 )
...
* Messagehub support update dict values
* Messagehub support update dict values
* fix assertion error message
2022-03-13 21:28:47 +08:00
Zaida Zhou
f548c81846
[Enhancement] Handle tensor device type in sync_random_seed ( #126 )
2022-03-13 17:45:02 +08:00
Mashiro
a7961407e4
[Refactor] Refactor the interfaces of Hook and its subclassed ( #117 )
...
* Fix hook
* Fix
* Fix docs
* FIx
* Fix
* Fix as comment
* update
* Fix hook
* Fix hook
* Fix hook
* Fix itertimerhook
* Fix iter_timer_hook
* Fix
* Fix
* fix logger hook
* Fix loggerhook
* update cur_dataloader
* Fix docstring
* Fix docstring
* Fix as commet
* Fix as commet
* Fix as comment
* rename is_last_epoch, enhance and add after_val before_val .etc
* fix typo in docstring
* remove resolved TODO
* refactor docstring
2022-03-13 16:48:09 +08:00
