1 Commits (71f00bfe9e03c9d34ec407ee7aa120c3ccf169cc)

Author	SHA1	Message	Date
Ross Wightman	29a37e23ee	LR scheduler update: ... * add polynomial decay 'poly' * cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt * add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909 * change default tanh ub/lb to push inflection to later epochs	2021-09-01 17:33:11 -07:00