4 Commits (2bfa5e5d742e2362ccca2fbf8610005834f24619)

Author	SHA1	Message	Date
fzyzcjy	b44e4e45a2	more	2024-04-02 10:25:30 +08:00
Ross Wightman	b1b024dfed	Scheduler update, add v2 factory method, support scheduling on updates instead of just epochs. Add LR to summary csv. Add lr_base scaling calculations to train script. Fix #1168	2022-10-07 10:43:04 -07:00
Ross Wightman	f0507f6da6	Fix k_decay default arg != 1.0 in poly scheduler	2021-11-22 09:37:36 -08:00
Ross Wightman	29a37e23ee	LR scheduler update: ... * add polynomial decay 'poly' * cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt * add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909 * change default tanh ub/lb to push inflection to later epochs	2021-09-01 17:33:11 -07:00