Ross Wightman fac58f609a Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. ...

* Add some of the trendy new optimizers. Decent results but not clearly better than the standards.
* Can create a None scheduler for constant LR
* ResNet defaults to zero_init of last BN in residual
* add resnet50d config

2019-08-28 00:14:10 -07:00

..

__init__.py

…

cosine_lr.py

…

plateau_lr.py

…

scheduler_factory.py

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

scheduler.py

A number of tweaks to arguments, epoch handling, config

2019-06-28 13:49:20 -07:00

step_lr.py

…

tanh_lr.py

Remove all prints, change most to logging calls, tweak alignment of batch logs, improve setup.py

2019-06-20 17:29:25 -07:00