Ross Wightman 1042b8a146 Add non fused LAMB optimizer option

2021-08-09 13:13:43 -07:00

..

__init__.py

adabelief

2021-04-04 23:48:15 -04:00

adabelief.py

Fix adabelief imports, remove prints, preserve memory format is the default arg for zeros_like

2021-04-12 08:25:31 -07:00

adafactor.py

Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support.

2020-10-09 17:24:43 -07:00

adahessian.py

Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support.

2020-10-09 17:24:43 -07:00

adamp.py

Add adamp and 'sgdp' optimizers.

2020-07-25 15:33:20 -07:00

adamw.py

…

lamb.py

Add non fused LAMB optimizer option

2021-08-09 13:13:43 -07:00

lookahead.py

Fix some attributions, add copyrights to some file docstrings

2020-07-27 13:44:56 -07:00

nadam.py

…

novograd.py

…

nvnovograd.py

Add Nvidia's NovogGrad impl from Jasper (cleaner/faster than current) and Apex Fused optimizers

2019-08-29 15:21:38 -07:00

optim_factory.py

Add non fused LAMB optimizer option

2021-08-09 13:13:43 -07:00

radam.py

…

rmsprop_tf.py

Fix some attributions, add copyrights to some file docstrings

2020-07-27 13:44:56 -07:00

sgdp.py

Add adamp and 'sgdp' optimizers.

2020-07-25 15:33:20 -07:00