Ross Wightman c1cf8c52b9 Update adafactor comments / attrib

2024-11-12 20:49:01 -08:00

..

__init__.py

Add ADOPT optimizer

2024-11-12 20:49:01 -08:00

adabelief.py

More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.

2021-08-18 17:21:56 -07:00

adafactor_bv.py

Update adafactor comments / attrib

2024-11-12 20:49:01 -08:00

adafactor.py

Update adafactor comments / attrib

2024-11-12 20:49:01 -08:00

adahessian.py

…

adamp.py

…

adamw.py

…

adan.py

…

adopt.py

Remove an indent level in init_group for adopt, update optim tests, adopt failing rosenbrock

2024-11-12 20:49:01 -08:00

lamb.py

A bit of lars/lamb cleanup, torch.where supports scalars properly now, make lamb grad clipping optional, clean it up a bit

2024-11-12 20:49:01 -08:00

lars.py

A bit of lars/lamb cleanup, torch.where supports scalars properly now, make lamb grad clipping optional, clean it up a bit

2024-11-12 20:49:01 -08:00

lion.py

…

lookahead.py

…

madgrad.py

…

nadam.py

…

nadamw.py

…

nvnovograd.py

…

optim_factory.py

Add ADOPT optimizer

2024-11-12 20:49:01 -08:00

radam.py

More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.

2021-08-18 17:21:56 -07:00

rmsprop_tf.py

…

sgdp.py

…

sgdw.py

…