mirrors
/
mmclassification
mirror of https://github.com/open-mmlab/mmclassification.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
mmclassification/mmpretrain/engine/optimizers/__init__.py

9 lines
297 B
Python
Raw Normal View History

[Enhance] Upgrade isort pre-commit hooks. (#687) * Use new version flake8 and isort hooks * Fix missing copyright
2022-02-17 02:17:20 +08:00
# Copyright (c) OpenMMLab. All rights reserved.
[Feature] Add adan optimizer. (#1180) * add adan optimizer * uppdate adan optimizer * uppdate adan optimizer * uppdate adan optimizer * uppdate adan optimizer * uppdate adan optimizer * uppdate adan optimizer * uppdate adan optimizer * uppdate adan optimizer * uppdate adan optimizer * uppdate init
2022-11-17 08:11:25 +08:00
from .adan_t import Adan
[Feature] Support LAMB optimizer. (#591) * impl lamb * Add unit tests * Fix unit test * Fix unit tests * Use list instead of tuple in `__all__` according to PEP8 Co-authored-by: mzr1996 <mzr1996@163.com>
2021-12-13 17:24:44 +08:00
from .lamb import Lamb
[Refactor] Add selfsup algorithms. (#1389) * remove basehead * add moco series * add byol simclr simsiam * add ut * update configs * add simsiam hook * add and refactor beit * update ut * add cae * update extract_feat * refactor cae * add mae * refactor data preprocessor * update heads * add maskfeat * add milan * add simmim * add mixmim * fix lint * fix ut * fix lint * add eva * add densecl * add barlowtwins * add swav * fix lint * update readtherdocs rst * update docs * update * Decrease UT memory usage * Fix docstring * update DALLEEncoder * Update model docs * refactor dalle encoder * update docstring * fix ut * fix config error * add val_cfg and test_cfg * refactor clip generator * fix lint * pass check * fix ut * add lars * update type of BEiT in configs * Use MMEngine style momentum in EMA. * apply mmpretrain solarize --------- Co-authored-by: mzr1996 <mzr1996@163.com>
2023-03-06 16:53:15 +08:00
from .lars import LARS
[Feature] Implement layer-wise learning rate decay optimizer constructor. (#1399) * [Feature] Implement layer-wise learning rate decay optimizer constructor. * Use num_layers instead of max_depth to avoid misleading * Add UT * Update docstring * Update log info * update LearningRateDecay configs --------- Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2023-03-07 17:30:39 +08:00
from .layer_decay_optim_wrapper_constructor import \
LearningRateDecayOptimWrapperConstructor
[Feature] Support LAMB optimizer. (#591) * impl lamb * Add unit tests * Fix unit test * Fix unit tests * Use list instead of tuple in `__all__` according to PEP8 Co-authored-by: mzr1996 <mzr1996@163.com>
2021-12-13 17:24:44 +08:00
[Feature] Implement layer-wise learning rate decay optimizer constructor. (#1399) * [Feature] Implement layer-wise learning rate decay optimizer constructor. * Use num_layers instead of max_depth to avoid misleading * Add UT * Update docstring * Update log info * update LearningRateDecay configs --------- Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2023-03-07 17:30:39 +08:00
__all__ = ['Lamb', 'Adan', 'LARS', 'LearningRateDecayOptimWrapperConstructor']