Ross Wightman c8b4511428 A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

..

__init__.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

_optim_factory.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

_param_groups.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

adabelief.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

adafactor_bv.py

Update adafactor comments / attrib

2024-11-12 09:30:26 -08:00

adafactor.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

adahessian.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

adamp.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

adamw.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

adan.py

…

adopt.py

Remove an indent level in init_group for adopt, update optim tests, adopt failing rosenbrock

2024-11-08 10:38:42 -08:00

lamb.py

A bit of lars/lamb cleanup, torch.where supports scalars properly now, make lamb grad clipping optional, clean it up a bit

2024-11-07 21:42:24 -08:00

lars.py

A bit of lars/lamb cleanup, torch.where supports scalars properly now, make lamb grad clipping optional, clean it up a bit

2024-11-07 21:42:24 -08:00

lion.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

lookahead.py

…

madgrad.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

nadam.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

nadamw.py

…

nvnovograd.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

radam.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

rmsprop_tf.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

sgdp.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00

sgdw.py

A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs

2024-11-12 16:13:17 -08:00