Ross Wightman 29a37e23ee LR scheduler update: ...

* add polynomial decay 'poly'
* cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt
* add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909
* change default tanh ub/lb to push inflection to later epochs

2021-09-01 17:33:11 -07:00

..

__init__.py

LR scheduler update:

2021-09-01 17:33:11 -07:00

cosine_lr.py

LR scheduler update:

2021-09-01 17:33:11 -07:00

multistep_lr.py

1. Added a simple multi step LR scheduler

2021-07-09 16:18:27 -04:00

plateau_lr.py

Fix some attributions, add copyrights to some file docstrings

2020-07-27 13:44:56 -07:00

poly_lr.py

LR scheduler update:

2021-09-01 17:33:11 -07:00

scheduler_factory.py

LR scheduler update:

2021-09-01 17:33:11 -07:00

scheduler.py

Revamp LR noise, move logic to scheduler base. Fixup PlateauLRScheduler and add it as an option.

2020-02-22 16:23:15 -08:00

step_lr.py

Fix some attributions, add copyrights to some file docstrings

2020-07-27 13:44:56 -07:00

tanh_lr.py

LR scheduler update:

2021-09-01 17:33:11 -07:00