Ross Wightman fac58f609a Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. ...

* Add some of the trendy new optimizers. Decent results but not clearly better than the standards.
* Can create a None scheduler for constant LR
* ResNet defaults to zero_init of last BN in residual
* add resnet50d config

2019-08-28 00:14:10 -07:00

..

__init__.py

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

adamw.py

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

lookahead.py

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

nadam.py

Big re-org, working towards making pip/module as 'timm'

2019-06-19 17:20:51 -07:00

novograd.py

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

optim_factory.py

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

radam.py

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

rmsprop_tf.py

Big re-org, working towards making pip/module as 'timm'

2019-06-19 17:20:51 -07:00