Ross Wightman 2d597b126d Missed extra nadam algo step for capturable path

2023-06-13 20:51:31 -07:00

..

__init__.py

Add Adan to __init__.py

2022-12-15 11:37:29 +08:00

adabelief.py

…

adafactor.py

…

adahessian.py

…

adamp.py

…

adamw.py

…

adan.py

Add Adan optimizer

2022-09-23 16:05:52 -07:00

lamb.py

…

lars.py

fix lars

2022-01-19 17:49:43 +08:00

lion.py

Add multi-tensor (foreach) version of Lion in style of upcoming PyTorch 2.0 optimizers

2023-02-16 15:48:00 -08:00

lookahead.py

Fix Pytorch 2.0 breakage for Lookahead optimizer adapter

2023-06-02 08:39:07 -07:00

madgrad.py

…

nadam.py

Add NadamW based on mlcommons algorithm, added multi-tensor step

2023-06-13 20:45:17 -07:00

nadamw.py

Missed extra nadam algo step for capturable path

2023-06-13 20:51:31 -07:00

nvnovograd.py

…

optim_factory.py

Add NadamW based on mlcommons algorithm, added multi-tensor step

2023-06-13 20:45:17 -07:00

radam.py

…

rmsprop_tf.py

…

sgdp.py

…