Ross Wightman b1b024dfed Scheduler update, add v2 factory method, support scheduling on updates instead of just epochs. Add LR to summary csv. Add lr_base scaling calculations to train script. Fix #1168

2022-10-07 10:43:04 -07:00

..

__init__.py

Add lamb/lars to optim init imports, remove stray comment

2021-08-18 22:55:02 -07:00

adabelief.py

…

adafactor.py

…

adahessian.py

…

adamp.py

…

adamw.py

…

adan.py

Add Adan optimizer

2022-09-23 16:05:52 -07:00

lamb.py

…

lars.py

fix lars

2022-01-19 17:49:43 +08:00

lookahead.py

…

madgrad.py

…

nadam.py

…

nvnovograd.py

…

optim_factory.py

Scheduler update, add v2 factory method, support scheduling on updates instead of just epochs. Add LR to summary csv. Add lr_base scaling calculations to train script. Fix #1168

2022-10-07 10:43:04 -07:00

radam.py

…

rmsprop_tf.py

…

sgdp.py

…