Ross Wightman 835a1a60ab Add guard around 'somewhat' newer torch RAdam / NAdam imports

2024-11-26 11:10:42 -08:00

..

__init__.py

Add guard around 'somewhat' newer torch RAdam / NAdam imports

2024-11-26 11:10:42 -08:00

_optim_factory.py

Replace radam & nadam impl with torch.optim ver, rename legacy adamw, nadam, radam impl in timm. Update optim factory & tests.

2024-11-26 10:54:17 -08:00

_param_groups.py

More fixes for new factory & tests, add back adahessian

2024-11-12 20:49:01 -08:00

adabelief.py

…

adafactor_bv.py

…

adafactor.py

…

adahessian.py

…

adamp.py

…

adamw.py

Replace radam & nadam impl with torch.optim ver, rename legacy adamw, nadam, radam impl in timm. Update optim factory & tests.

2024-11-26 10:54:17 -08:00

adan.py

Update Adan with newer impl (from original source) that includes multi-tensor fn

2024-11-26 10:55:20 -08:00

adopt.py

Update Adopt to include clipping for stability, separate wd so no param decay if update not taken on first step

2024-11-26 10:42:01 -08:00

lamb.py

…

laprop.py

Add MARS and LaProp impl, simplified from originals

2024-11-26 10:51:53 -08:00

lars.py

…

lion.py

…

lookahead.py

…

madgrad.py

…

mars.py

Add MARS and LaProp impl, simplified from originals

2024-11-26 10:51:53 -08:00

nadam.py

Replace radam & nadam impl with torch.optim ver, rename legacy adamw, nadam, radam impl in timm. Update optim factory & tests.

2024-11-26 10:54:17 -08:00

nadamw.py

…

nvnovograd.py

…

optim_factory.py

More fixes for new factory & tests, add back adahessian

2024-11-12 20:49:01 -08:00

radam.py

Replace radam & nadam impl with torch.optim ver, rename legacy adamw, nadam, radam impl in timm. Update optim factory & tests.

2024-11-26 10:54:17 -08:00

rmsprop_tf.py

…

sgdp.py

…

sgdw.py

…