pytorch-image-models/timm/optim/__init__.py

from .adamp import AdamP
from .adamw import AdamW
from .adafactor import Adafactor
from .adahessian import Adahessian
from .lookahead import Lookahead
from .nadam import Nadam
from .novograd import NovoGrad
from .nvnovograd import NvNovoGrad
from .radam import RAdam
from .rmsprop_tf import RMSpropTF
from .sgdp import SGDP

from .optim_factory import create_optimizer
Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support. 2020-10-10 08:24:08 +08:00			`from .adamp import AdamP`
Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. * Add some of the trendy new optimizers. Decent results but not clearly better than the standards. * Can create a None scheduler for constant LR * ResNet defaults to zero_init of last BN in residual * add resnet50d config 2019-08-28 15:14:10 +08:00			`from .adamw import AdamW`
Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support. 2020-10-10 08:24:08 +08:00			`from .adafactor import Adafactor`
			`from .adahessian import Adahessian`
			`from .lookahead import Lookahead`
			`from .nadam import Nadam`
Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. * Add some of the trendy new optimizers. Decent results but not clearly better than the standards. * Can create a None scheduler for constant LR * ResNet defaults to zero_init of last BN in residual * add resnet50d config 2019-08-28 15:14:10 +08:00			`from .novograd import NovoGrad`
Add Nvidia's NovogGrad impl from Jasper (cleaner/faster than current) and Apex Fused optimizers 2019-08-30 06:21:38 +08:00			`from .nvnovograd import NvNovoGrad`
Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support. 2020-10-10 08:24:08 +08:00			`from .radam import RAdam`
			`from .rmsprop_tf import RMSpropTF`
Add `adamp` and 'sgdp' optimizers. Update requirements.txt Update optim_factory.py Add `adamp` optimizer Update __init__.py copy files of adamp & sgdp Create adamp.py Update __init__.py Create sgdp.py Update optim_factory.py Update optim_factory.py Update requirements.txt Update adamp.py Update sgdp.py Update sgdp.py Update adamp.py 2020-07-22 10:02:05 +08:00			`from .sgdp import SGDP`
Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support. 2020-10-10 08:24:08 +08:00
			`from .optim_factory import create_optimizer`