Ross Wightman fac58f609a Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. ... * Add some of the trendy new optimizers. Decent results but not clearly better than the standards. * Can create a None scheduler for constant LR * ResNet defaults to zero_init of last BN in residual * add resnet50d config		2019-08-28 00:14:10 -07:00
..
__init__.py	Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.	2019-08-28 00:14:10 -07:00
adamw.py	Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.	2019-08-28 00:14:10 -07:00
lookahead.py	Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.	2019-08-28 00:14:10 -07:00
nadam.py	Big re-org, working towards making pip/module as 'timm'	2019-06-19 17:20:51 -07:00
novograd.py	Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.	2019-08-28 00:14:10 -07:00
optim_factory.py	Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.	2019-08-28 00:14:10 -07:00
radam.py	Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.	2019-08-28 00:14:10 -07:00
rmsprop_tf.py	Big re-org, working towards making pip/module as 'timm'	2019-06-19 17:20:51 -07:00