mirrors
/
pytorch-image-models
mirror of https://github.com/huggingface/pytorch-image-models.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
pytorch-image-models/timm/optim/__init__.py

11 lines
300 B
Python
Raw Normal View History

Change some absolute imports to relative
2019-06-20 07:08:58 +08:00
from .nadam import Nadam
from .rmsprop_tf import RMSpropTF
Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. * Add some of the trendy new optimizers. Decent results but not clearly better than the standards. * Can create a None scheduler for constant LR * ResNet defaults to zero_init of last BN in residual * add resnet50d config
2019-08-28 15:14:10 +08:00
from .adamw import AdamW
from .radam import RAdam
from .novograd import NovoGrad
Add Nvidia's NovogGrad impl from Jasper (cleaner/faster than current) and Apex Fused optimizers
2019-08-30 06:21:38 +08:00
from .nvnovograd import NvNovoGrad
Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. * Add some of the trendy new optimizers. Decent results but not clearly better than the standards. * Can create a None scheduler for constant LR * ResNet defaults to zero_init of last BN in residual * add resnet50d config
2019-08-28 15:14:10 +08:00
from .lookahead import Lookahead
Add `adamp` and 'sgdp' optimizers. Update requirements.txt Update optim_factory.py Add `adamp` optimizer Update __init__.py copy files of adamp & sgdp Create adamp.py Update __init__.py Create sgdp.py Update optim_factory.py Update optim_factory.py Update requirements.txt Update adamp.py Update sgdp.py Update sgdp.py Update adamp.py
2020-07-22 10:02:05 +08:00
from .adamp import AdamP
from .sgdp import SGDP
Change some absolute imports to relative
2019-06-20 07:08:58 +08:00
from .optim_factory import create_optimizer