354 Commits

Author SHA1 Message Date
Xinyu Yang
4fdab5e9cb
[Fix] Fix Visualizer that built vis_backends will not be used when save_dir is None (#1275) 2023-07-31 15:29:44 +08:00
Zaida Zhou
2df93eb51f
Add the loop stage in message_hub (#1277) 2023-07-31 14:22:49 +08:00
Mashiro
237aee3866
[Enhance] Enhance error information in build function (#1088) 2023-07-28 11:21:09 +08:00
youkaichao
ee742da254
[Enhance] Use graph transform to deal with more general cases for efficient_conv_bn_eval (#1259) 2023-07-26 17:52:57 +08:00
vugia truong
c8a1264568
[Feature] Compare the difference of two configs (#1260) 2023-07-26 15:48:59 +08:00
KerwinKai
68360e7ce8
[Feature] Add parameter save_begin for CheckpointHook (#1271) 2023-07-25 19:21:21 +08:00
Mashiro
3871881ef6
[Enhance] Support skipping initialization in BaseModule (#1263) 2023-07-25 12:56:42 +08:00
youkaichao
66d828d8d3
[Enhancement] Rename fast_conv_bn_eval to efficient_conv_bn_eval (#1251) 2023-07-15 22:13:17 +08:00
i-aki-y
276c614bf5
[Fix] Fix scalar check in RuntimeInfoHook (#1250) 2023-07-15 22:03:43 +08:00
youkaichao
40e49ff747
[Feature] Enable fast conv bn eval (#1202) 2023-07-14 18:21:55 +08:00
Qingyun
de81d29abd
[Fix] Fix the logic of setting lazy_import (#1239) 2023-07-11 22:32:20 +08:00
Mashiro
955b5712c4
[Fix] Fix pickle the Python style config (#1241) 2023-07-11 20:37:48 +08:00
Mashiro
8d4bac2616
[Enhance] Enhance config (#1232) 2023-07-05 23:27:08 +08:00
Mashiro
317d8f3178
[Fix] Remove auto find_ignored_modules (#1231) 2023-07-03 19:54:54 +08:00
Mashiro
d5a46d4144
[Fix] Implement copy and __copy__ for ConfigDict (#1230) 2023-07-03 15:11:10 +08:00
Mashiro
20d477dae1
[Enhancement] Only recognize modules mixed gradients as ignored_modules (#1226) 2023-07-01 22:50:36 +08:00
Mashiro
b638d3b1fe
[Fix] Fix new config (#1227) 2023-07-01 22:35:11 +08:00
Mashiro
1480261e8f
[Enhance] Config adds copy method (#1224) 2023-06-30 17:11:16 +08:00
Mashiro
f930b9fe53
Fix docstring format (#1223) 2023-06-30 10:39:19 +08:00
Mashiro
399f76ffa8 [Experimental] Add support for FSDP (#1213) 2023-06-29 15:19:33 +08:00
Mashiro
478c952a6d
[Refacor] Replace 'if base' with 'with read_base' context manager (#1207) 2023-06-25 13:53:19 +08:00
Mashiro
04b0ffee76
[Fix] Fix ut error in docker (#1204) 2023-06-16 22:05:08 +08:00
Mashiro
6ece63ed35
[Feature] Support Pure Python style Configuration File (#1071) 2023-06-16 12:52:07 +08:00
Akide Liu
94e7a3bb57
[Enhance] Learning rate in log can show the base learning rate of optimizer (#1019) 2023-06-08 19:51:15 +08:00
Zaida Zhou
19aa1eb780
[Fix] Save checkpoint again to update best_ckpt of ckpt (#1168) 2023-06-02 14:42:56 +08:00
i-aki-y
6df9621a06
[Feature] Add support for full wandb's define_metric arguments (#1099) 2023-06-01 21:50:29 +08:00
vugia truong
68414516aa
[Feature] Add vis backend for clearml (#878) (#1091) 2023-06-01 17:41:34 +08:00
Zaida Zhou
193b7fdfcc
[Refactor] Let unit tests not affect each other (#1169) 2023-05-27 22:36:04 +08:00
Mashiro
5d4e72144a
[Fix] Fix ProfileHook can not profile performance in ddp-training (#1140) 2023-05-26 10:55:15 +08:00
Mashiro
2085046d22
[Fix] The ann_file and data_root of BaseDataset can be None (#850) 2023-05-04 22:22:52 +08:00
Mashiro
3715fea15b
[Refactor] Refactor the unit tests of SyncBuffersHook (#813) 2023-04-28 17:32:30 +08:00
Mashiro
298a4b1e49
[Fix] Fix build unnecessary loop during train/test/val (#1107)
* [Fix] Fix build unnecessary loop during train/test/val

* move unit test to runner

* Update unit test

* Fix unit test

* check train_loop is None

* update comment

* replace(type(None)) with is not None
2023-04-27 19:20:35 +08:00
Ma Zerun
49b27dd83f
[Imporve] Support _load_state_dict_post_hooks in load_state_dict. (#1103)
* [Imporve] Support `_load_state_dict_post_hooks` in `load_state_dict`.

* Update

* Add unit test
2023-04-26 16:48:57 +08:00
Mashiro
6ba667c8cf
[Fix] Save optimizer.state_dict() in cpu by default (#966) 2023-04-26 16:47:47 +08:00
Mashiro
9868131c98
[Enhance] Enhance error message during custom import (#1102) 2023-04-26 11:08:58 +08:00
Zaida Zhou
cdec4cbd4a
[Fix] collate_fn does not support passing a function object (#1093) 2023-04-24 20:42:54 +08:00
shufan wu
2aef53d3fa
[Fix] No training log when the num of iterations is smaller than the interval (#1046) 2023-04-24 12:29:20 +08:00
Mashiro
4afed1332b
[Enhance] Visualizer.show supports calling opencv to show images (#1015)
* [Enhance] Enhance the efficiency of Visualizer.show

* Update unit test

* Simplify the logic of creating opencv window

* Update docstring

* Update unit test

* Update mmengine/visualization/visualizer.py

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2023-04-23 20:30:29 +08:00
cyberslack_lee
0687b377b2
[Enhancement] MessageHub.get_info() supports returning a default value (#991) 2023-04-23 17:35:35 +08:00
sjiang95
fafb476e58
[Feature] get_model_complexity_info() supports multiple inputs (#1065) 2023-04-23 16:11:31 +08:00
Mashiro
17c5414d16
[Fix] Fix the resuming error caused by HistoryBuffer (#1078) 2023-04-21 17:23:38 +08:00
Mashiro
f1aca8e307
[Fix] Failed to remove the previous best checkpoints (#1086)
* [Fix] Only reserve one best checkpoint

* [Fix] Only reserve one best checkpoint

* Fix unit test

* shutdown logging

* clean the save_checkpoint logic
2023-04-20 21:28:56 +08:00
Mashiro
be347df770
[Fix] KeyError is thrown in _collect_scalars when log_with_hierarchy is True (#1085)
* Fix log processor

* Fix custom key
2023-04-20 10:52:32 +08:00
Mashiro
a7d4b7c742
[Enhance] Support configuring directory used to synchronize results in BaseMetric (#1074)
* [Enhance] Support configuring synchronize directory for BaseMetric

* Raise error if tmpdir is not an shared dirctory for ann ranks

* Raise error if tmpdir is not an shared dirctory for ann ranks

* Update mmengine/evaluator/metric.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* refine

* Update mmengine/evaluator/metric.py

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2023-04-14 19:15:04 +08:00
黄启元
60b4c199fc
[Feature] Support MLU backend (#1075)
* support mlu device

* support mlu device

* fix lint error

* fix lint error builder.py

* fix lint error in amp.py

* fix lint errors

* fix data type in instance_data.py
2023-04-14 19:06:19 +08:00
Qian Zhao
b2ad2210b5
[Feature] Support registering partial functions and more (#595)
* support registering partial functions

* Update mmengine/registry/build_functions.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Update mmengine/registry/registry.py

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>

* Revert unit test and refine

* add current logger and set log level

---------

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
Co-authored-by: HAOCHENYE <21724054@zju.edu.cn>
2023-04-10 19:42:04 +08:00
shufan wu
5e1ed7aaf0
[Enhance] Allow users to customize worker_init_fn of Dataloader (#1038)
* customize worker init fn function

* add assert

* narrow worker_init_fn type
2023-04-10 17:32:36 +08:00
sung-hwa kim
8bf1ecad38
[Feature] Add vis backend for MLflow. (#878)
* add vis mlflow backend
2023-04-07 16:35:41 +08:00
Mashiro
5762b28847
[Refactor] Refactor logger hook unit tests (#797)
* Enhance config

* add unit test data

* reafactor unittest of loggerhook

* fix rebase error

* Fix permission error in windows

* Fix CI

* Fix windows ci

* Fix windows ci

* Fix windows ci

* Fix windows CI

* Apply suggestions from code review

Co-authored-by: Qian Zhao <112053249+C1rN09@users.noreply.github.com>

* clean the code

* Refine as comment

* Refine error rasing

* Update mmengine/hooks/logger_hook.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* replace assert_called_with with assert_has_calls

* Fix as comment

* Do not remove filehandler and fix unit test

---------

Co-authored-by: Qian Zhao <112053249+C1rN09@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2023-04-07 16:20:38 +08:00
Mashiro
2dbc8ed253
[Refactor] Refactor checkpointhook unit tests (#789)
* Enhance config

* add unit test data

* Refacotr unitest of checkpointhook

* add comments

* Fix unit test

* remove _get_metric_scope

* tmp save

* Revert "remove _get_metric_scope"

This reverts commit eeb7a8c5ed2766bf773a9ed28f731fddacd10ac1.

* Revert "Revert "remove _get_metric_scope""

This reverts commit 5398255f6fb3dac8341f7d808f0d7d09350fcaae.

* Revert "tmp save"

This reverts commit cdc9919be8e0a78bbf264c060de2a4396c137d5a.

* clean the code

* Fix ut

* minor fix

* use str.replace
2023-04-06 10:55:16 +08:00