mirrors
/
mmengine
mirror of https://github.com/open-mmlab/mmengine.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
393 Commits
31 Branches
27 Tags
20 MiB
Commit Graph

393 Commits (c1178fad8fce4b19e8a640ddb76650af27b0bef1)
 

Author SHA1 Message Date
Wenwei Zhang 5c3b8e456c
Merge Adaptation branch to main branch 2022-04-26 13:54:05 +08:00
Wenwei Zhang 96f3d97fc4
Try to fix lint issue (#199) 
* try to fix lint

* upgrade yapf version

* use another way to bypass yapf

* update docstring
 2022-04-26 13:53:00 +08:00
HAOCHENYE 9d0d7536c8 merge main 2022-04-26 10:38:57 +08:00
Mashiro e0d00c5bdd
[Fix] resolve conflict betweem adapt and main. (#198) 
* [Docs] Refine registry documentation (#186)

* [Docs] Refine registry documentation

* reslove comments

* minor refinement

* Refine Visualizer docs (#177)

* Refine Visualizer docs

* update

* update

* update featmap

* update docs

* update visualizer docs

* [Refactor] Refine LoggerHook (#155)

* rename global accessible and intergration get_sintance and create_instance

* move ManagerMixin to utils

* fix as docstring and seporate get_instance to get_instance and get_current_instance

* fix lint

* fix docstring, rename and move test_global_meta

* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume

* refine MMLogger timestamp, update unit test

* MMLogger add logger_name arguments

* Fix docstring

* Add LogProcessor and some unit test

* update unit test

* complete LogProcessor unit test

* refine LoggerHook

* solve circle import

* change default logger_name to mmengine

* refactor eta

* Fix docstring comment and unitt test

* Fix with runner

* fix docstring

fix docstring

* fix docstring

* Add by_epoch attribute to LoggerHook and fix docstring

* Please mypy and fix comment

* remove \ in MMLogger

* Fix lint

* roll back pre-commit-hook

* Fix hook unit test

* Fix comments

* remove \t in log and add docstring

* Fix as comment

* should not accept other arguments if corresponding instance has been created

* fix logging ddp file saving

* fix logging ddp file saving

* move log processor to logging

* move log processor to logging

* remove current datalaoder

* fix docstring

* fix unit test

* add learing rate in messagehub

* Support output training/validation/testing message after iterations/epochs

* fix docstring

* Fix IterBasedRunner log string

* Fix IterBasedRunner log string

* Support parse validation loss in log processor

* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR (#188)

* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR

* min_lr -> eta_min, refined docstr

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Haian Huang(深度眸) <1286304229@qq.com>
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>
 2022-04-26 00:37:16 +08:00
Tong Gao c3aff4fc9a
[Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR (#188) 
* [Enhancement] Add PolyParamScheduler, PolyMomentum and PolyLR

* min_lr -> eta_min, refined docstr
 2022-04-25 13:44:15 +08:00
Mashiro e2a2b0438e
[Refactor] Refine LoggerHook (#155) 
* rename global accessible and intergration get_sintance and create_instance

* move ManagerMixin to utils

* fix as docstring and seporate get_instance to get_instance and get_current_instance

* fix lint

* fix docstring, rename and move test_global_meta

* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume

* refine MMLogger timestamp, update unit test

* MMLogger add logger_name arguments

* Fix docstring

* Add LogProcessor and some unit test

* update unit test

* complete LogProcessor unit test

* refine LoggerHook

* solve circle import

* change default logger_name to mmengine

* refactor eta

* Fix docstring comment and unitt test

* Fix with runner

* fix docstring

fix docstring

* fix docstring

* Add by_epoch attribute to LoggerHook and fix docstring

* Please mypy and fix comment

* remove \ in MMLogger

* Fix lint

* roll back pre-commit-hook

* Fix hook unit test

* Fix comments

* remove \t in log and add docstring

* Fix as comment

* should not accept other arguments if corresponding instance has been created

* fix logging ddp file saving

* fix logging ddp file saving

* move log processor to logging

* move log processor to logging

* remove current datalaoder

* fix docstring

* fix unit test

* add learing rate in messagehub

* Support output training/validation/testing message after iterations/epochs

* fix docstring

* Fix IterBasedRunner log string

* Fix IterBasedRunner log string

* Support parse validation loss in log processor
 2022-04-24 19:23:28 +08:00
Haian Huang(深度眸) 4274679376
Refine Visualizer docs (#177) 
* Refine Visualizer docs

* update

* update

* update featmap

* update docs

* update visualizer docs
 2022-04-24 19:21:10 +08:00
Zaida Zhou 7e123ad6d6
[Docs] Refine registry documentation (#186) 
* [Docs] Refine registry documentation

* reslove comments

* minor refinement
 2022-04-22 20:45:13 +08:00
Wenwei Zhang fb7d8ccd6b
Manually fully initialize the dataset in runner when building dataloader (#190) 
* full init the dataset when building data loader

* resolve comments
 2022-04-22 20:44:52 +08:00
ZwwWayne 4f5c0cd273 Merge branch 'main' of github.com:open-mmlab/mmengine into adapt 2022-04-22 13:52:48 +08:00
Tao Gong a3b8d4ea56
Refactor docs of basedataset (#175) 
* refactor docs of basedataset

* fix ci

* fix comments

* fix comments

* fix comments

* fix comments

* fix comments

* set default value of ann_file to ''

* fix comments
 2022-04-22 13:51:57 +08:00
ZwwWayne ae3b857480 Merge branch 'adapt' of github.com:open-mmlab/mmengine into adapt 2022-04-22 13:48:14 +08:00
Yining Li d2e4c6b683
[Doc] Update docs of metrics and evaluator (#183) 
* update docs of metrics and evaluator

* rename file

* resolve comments
 2022-04-22 13:02:04 +08:00
Mashiro 82a313d09b
[Enhancement] Refine logging. (#148) 
* rename global accessible and intergration get_sintance and create_instance

* move ManagerMixin to utils

* fix as docstring and seporate get_instance to get_instance and get_current_instance

* fix lint

* fix docstring, rename and move test_global_meta

* rename LogBuffer to HistoryBuffer, rename MessageHub methods, MessageHub support resume

* refine MMLogger timestamp, update unit test

* MMLogger add logger_name arguments

* Fix docstring

* change default logger_name to mmengine

* Fix docstring comment and unitt test

* fix docstring

fix docstring

* fix docstring

* Fix lint

* Fix hook unit test

* Fix comments

* should not accept other arguments if corresponding instance has been created

* fix logging ddp file saving

* fix logging ddp file saving

* fix docstring

* fix unit test

* fix docstring as comment
 2022-04-21 19:12:10 +08:00
Mashiro 45567b1d1c
automaticaly update iter and epoch in message_hub (#168) 
* automatic update iter and epoch in message_hub

* add docstring

* Update comment and docstring

* Fix as comment

* Fix docstring and comment

* refine comments
 2022-04-21 11:45:03 +08:00
Zaida Zhou 53101a1ab1
[Docs] Refine hook documentation (#181) 
* Modify hook documentation

* reslove comments
 2022-04-20 13:28:26 +08:00
RangiLyu ecf816e1e9
[Doc] Refine runner doc. (#178) 
* [Doc] Refine runner doc.

* resolve comments
 2022-04-20 13:26:47 +08:00
Mashiro 55713207b0
[Refactor] Refactor logging tutorial docs (#179) 
* Refactor logging tutorial docs

* Add logging flow description

* fix docstring as comment

fix docstring as comment

* fix logging tutorial
 2022-04-20 13:22:40 +08:00
Wenwei Zhang 7367df7ea7
Update docs of data element (#180) 
* refine docs of data element

* update

* resolve comments
 2022-04-20 13:16:31 +08:00
liukuikun 5f8f36e6a5
refactor visualization (#147) 
* [WIP] add inline

* refactor vis module

* [Refactor] according review

* [Fix] fix comment

* fix some error

* Get sub visualizer be Visualizer.get_instance

* fix conflict

* fix lint

* fix unit test

* fix mypy

* fix comment

* fix lint

* update docstr

* update

* update instancedata

* remove replace __mro__ with issubclass

Co-authored-by: PJLAB\huanghaian <1286304229@qq.com>
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>
 2022-04-15 15:56:06 +08:00
Mashiro 605e78be82
Haochenye/fix logging (#167) 
* remove LoggerHook master_only

* remogve \t in log string

* fix lint

* Fix lint
 2022-04-12 21:50:30 +08:00
RangiLyu 6e4bcc997d
[Fix] Fix resume from checkpoint. (#174) 2022-04-12 21:49:31 +08:00
RangiLyu 798eab4825
[Feature] Support build batch sampler. (#173) 2022-04-12 09:54:30 +08:00
RangiLyu 3d830a28b6
[Fix]: Fix is_model_wrapper and add DistSamplerSeedHook to default hooks. (#172) 
* [Fix]: Fix model_wrapper and add DistSamplerSeedHook as default hook.

* add comments
 2022-04-08 22:18:23 +08:00
ZwwWayne 93d22757cf Merge branch 'main' into adapt 2022-04-08 16:02:05 +08:00
Mashiro 66e528830b
[Typo]: replace date_bytes to data_bytes (#170) 2022-04-08 15:58:49 +08:00
Zaida Zhou 50650e0b7a
[Enhancement] Refactor the unit tests of dist module with MultiProcessTestCase (#138) 
* [Enhancement] Provide MultiProcessTestCase to test distributed related modules

* remove debugging info

* add timeout property

* [Enhancement] Refactor the unit tests of dist module with MultiProcessTestCase

* minor refinement

* minor fix
 2022-04-08 15:58:03 +08:00
RangiLyu 59cc08e3ac
[Refactor] Refactor data_batch type and remove cur_dataloader in runner. (#171) 
* [Refactor] Refactor data_batch type.

* fix sampler

* [Refactor] Remove cur_dataloader in runner.

* fix set_epoch
 2022-04-08 15:57:10 +08:00
RangiLyu ab8b51682f
[Fix] Init weights after build model. (#164) 
* [Fix] Init weights after build model.

* add unit tests and docstring
 2022-04-05 17:44:59 +08:00
ZwwWayne 87da7599ae Merge branch 'main' into adapt 2022-04-01 19:46:41 +08:00
RangiLyu 2d80367893
[Refactor] Refactor Evaluator to Metric. (#152) 
* [Refactor] Refactor Evaluator to Metric.

* update

* fix lint

* fix doc

* fix lint

* resolve comments

* resolve comments

* remove collect_device from evaluator

* rename
 2022-04-01 15:06:38 +08:00
Mashiro 2fdca03f19
[Enhancement] Support get sub dataset and rename method and variable. (#145) 
* add get_subset method, add comment, rename variable

* add unit test

* Please mypy

* Fix as comment, support negative index, and fix index access error

* add and refine docstring, handle indices=0

* handle indices=0

* add empty list indices test

* rename in_meta in docstring and comments to in_metainfo

* clean meta nameing

* Fix negative indices error

* test empty list of get_subset

* fix comments and docstring

* add unit test

* Fix as comment

* Fix as comment

* add docstring to mention wrapped dataset should not inherit from Basedataset

* Fix wrapped dataset docstring

* Fix wrapped dataset docstring

* Fix method name, docstring, and comments

* Fix comments

* Fix comments

* Fix comments
 2022-04-01 14:51:11 +08:00
ZwwWayne a39d959eeb Merge branch 'main' into adapt 2022-04-01 13:08:39 +08:00
Zaida Zhou 8b4d7ddaa2
Add circleci (#157) 
* Add circleci

* fix typo

* lower required coverage

* support initialzing distributed environemtn without GPUs

* fix unit tests

* add approval for running gpu tests

* add approval for running gpu tests

* fix unit tests

* fix unit tests
 2022-04-01 13:07:29 +08:00
Zaida Zhou 0ca54eb71b
[Fix] Fix unit tests when gpu is not available (#163) 2022-04-01 12:50:15 +08:00
RangiLyu 25014af3c3
[Refactor] Refactor default_scope in Registry. (#158) 2022-04-01 09:13:55 +08:00
Haian Huang(深度眸) dc594e75bf
[Feature] Add InstanceData (#160) 
* [Enhancement] refactor base data elment

* fix comment

* fix comment

* fix pop not existing key without error

* add instance_data

* update

* refine code

* add refer

Co-authored-by: liukuikun <641417025@qq.com>
 2022-03-31 23:30:00 +08:00
Zaida Zhou e80267ae06
[Fix] Fix unit tests of evaluator (#162) 2022-03-31 23:25:50 +08:00
Zaida Zhou 1927bc7726
fix typo (#161) 2022-03-31 18:29:45 +08:00
liukuikun 7e246b6f65
[Enhancement] refactor base data element (#143) 
* [Enhancement] refactor base data elment

* fix comment

* fix comment

* fix pop not existing key without error
 2022-03-31 18:21:45 +08:00
Zaida Zhou cf0363141a
Update pytest.ini (#156) 2022-03-30 23:26:12 +08:00
Zaida Zhou f1de071cf0
[Enhancement] Refactor Runner (#139) 
* [Enhancement] Rename build_from_cfg to from_cfg

* refactor build_logger and build_message_hub

* remove time.sleep from unit tests

* minor fix

* move set_randomness from setup_env

* improve docstring

* refine comments

* print a warning information

* refine comments

* simplify the interface of build_logger
 2022-03-30 14:26:40 +08:00
RangiLyu 9a61b389e7
[Refactor] Add batch_idx to hook input. (#140) 
* [Refactor] Add batch_idx to hook input.

* update
 2022-03-29 11:40:38 +08:00
Mashiro 563b4bad16
[Feature] add defaut scope (#149) 
* add defaut scope

* Fix docstring

* override get_current_instance method in DefaultScope

clean meta nameing

* remove default mmengine argument of DefaltScope

remove default mmengine argument of DefaltScope

remove default mmengine argument of DefaltScope

* Fix unit test

Fix unit test

* Fix example in docstring

* add explaination of DefaultScope
 2022-03-28 23:14:41 +08:00
Mashiro 1048584147
[Enhancement] Refine GlobalAccessble (#144) 
* rename global accessible and intergration get_sintance and create_instance

* move ManagerMixin to utils

* fix as docstring and seporate get_instance to get_instance and get_current_instance

* fix lint

* fix docstring, rename and move test_global_meta

* fix manager's runtime error description

fix manager's runtime error description

* Add comments

* Add comments
 2022-03-26 21:21:25 +08:00
Zaida Zhou 2bf099d33c
[Feature] Add MultiProcessTestCase (#136) 
* [Enhancement] Provide MultiProcessTestCase to test distributed related modules

* remove debugging info

* add timeout property
 2022-03-26 20:38:25 +08:00
Yuan Liu 26f24296db
[Feature]: Add dist semantics in checkpoint hook (#131) 
* [Feature]: Add dist semantics in checkpoint hook

* [Fix]: Delete sync buffer in checkpoint hook
 2022-03-25 13:46:31 +08:00
Zaida Zhou e4859030af
[Docs] Update registry documentation (#133) 2022-03-25 11:29:34 +08:00
Zaida Zhou aee6d7a769
[Docs] Improve type hint style (#125) 2022-03-25 11:26:05 +08:00
Zaida Zhou 248ad9aee8
[Feature] Add Runner and Loop (#86) 
* [Feature] Add Runner and Loop

* refine docstring

* refine docstring

* refine __init__ of Runner

* add Runner.save_checkpoint

* add comment for data_batch

* rename validation_cfg to val_cfg

* update branch

* update branch

* discard wear reference

* set seed for torch in dataloader worker

* refine comments

* reorder methods

* import module in __init__.py

* add runner.load_checkpoint

* rename attributes

* fix indent

* fix indent

* add comment for LOOPS

* add example for methods

* add example for methods

* refine examples

* add Runner.resume and refactor register_hooks

* remove type hint of runner in CheckpointHook

* rename before_run to before_train

* remove collate

* add before_run after_run for loop.run

* dummy collate_fn

* add more unit tests

* move call_hook('before_run') to runner

* minor fix

* add comments for collate_fn

* fix type hint

* refactor logic to load or resume checkpoint

* fix typo

* add comments for IterBasedTrainLoop

* refactor unit tests

* fix unit tests

* refactor

* fix setup_env

* refine

* minor fix

* Merge branch 'main' of github.com:open-mmlab/mmengine into zzd/add-runner

* minor fix

* minor fix

* refine

* refactor unit tests

* fix unit tests

* add launcher property

* add logger, message_hub and writer unit tests

* add cur_dataloader attribute for runner

* fix IterBasedTrainLoop

* add torch.no_grad decorator

* add master_only decorator for save_checkpoint

* add before_test_epoch in TestLoop

* refactor load_or_resume method

* refine docstring

* fix typo

* build_dataloader can handle dataset object

* add dump_config for runner

* collate_fn should not a lambda function

* minor fix

* refine docstring

* fix unit tests

* improve comments

* refine unit tests

* rename collate_fn to pseduo_collate

* add 'TODO' tag
 2022-03-14 13:19:29 +08:00