Ross Wightman fac58f609a Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. ...

* Add some of the trendy new optimizers. Decent results but not clearly better than the standards.
* Can create a None scheduler for constant LR
* ResNet defaults to zero_init of last BN in residual
* add resnet50d config

2019-08-28 00:14:10 -07:00

..

data

Merge remote-tracking branch 'origin/re-exp' into opt

2019-08-26 14:29:23 -07:00

loss

…

models

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

optim

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

scheduler

Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.

2019-08-28 00:14:10 -07:00

__init__.py

Add model registry and model listing fns, refactor model_factory/create_model fn

2019-06-23 18:22:16 -07:00

utils.py

Add explicit half/fp16 support to loader and validation script

2019-07-05 13:52:25 -07:00

version.py

Bump version for next push to pypi

2019-08-25 22:32:12 -07:00