alec.tu 942726db31 import lion in __init__.py

2023-07-27 09:26:57 +08:00

..

__init__.py

import lion in __init__.py

2023-07-27 09:26:57 +08:00

adabelief.py

…

adafactor.py

More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.

2021-08-18 17:21:56 -07:00

adahessian.py

Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support.

2020-10-09 17:24:43 -07:00

adamp.py

…

adamw.py

…

adan.py

…

lamb.py

…

lars.py

fix lars

2022-01-19 17:49:43 +08:00

lion.py

…

lookahead.py

…

madgrad.py

…

nadam.py

…

nadamw.py

Missed extra nadam algo step for capturable path

2023-06-13 20:51:31 -07:00

nvnovograd.py

…

optim_factory.py

…

radam.py

…

rmsprop_tf.py

…

sgdp.py

More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.

2021-08-18 17:21:56 -07:00