Ross Wightman a6af48be64 add madgradw optimizer

2021-08-17 22:19:27 -07:00

..

__init__.py

A few optimizer comments, dead import, missing import

2021-08-17 18:01:33 -07:00

adabelief.py

Remove experiment from lamb impl

2021-08-17 21:48:26 -07:00

adafactor.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00

adahessian.py

Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support.

2020-10-09 17:24:43 -07:00

adamp.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00

adamw.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00

lamb.py

Remove experiment from lamb impl

2021-08-17 21:48:26 -07:00

lookahead.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00

madgrad.py

add madgradw optimizer

2021-08-17 22:19:27 -07:00

nadam.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00

nvnovograd.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00

optim_factory.py

add madgradw optimizer

2021-08-17 22:19:27 -07:00

radam.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00

rmsprop_tf.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00

sgdp.py

Optimizer improvements, additions, cleanup

2021-08-17 17:51:20 -07:00