7 Commits (ac670981471cee81efef580bfdfded9307e4b20b)

Author	SHA1	Message	Date
Ross Wightman	b1b024dfed	Scheduler update, add v2 factory method, support scheduling on updates instead of just epochs. Add LR to summary csv. Add lr_base scaling calculations to train script. Fix #1168	2022-10-07 10:43:04 -07:00
Ross Wightman	29a37e23ee	LR scheduler update: ... * add polynomial decay 'poly' * cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt * add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909 * change default tanh ub/lb to push inflection to later epochs	2021-09-01 17:33:11 -07:00
Ross Wightman	7995295968	Merge branch 'logger' into features. Change 'logger' to '_logger'.	2020-07-27 18:00:46 -07:00
Ross Wightman	6c17d57a2c	Fix some attributions, add copyrights to some file docstrings	2020-07-27 13:44:56 -07:00
Ross Wightman	d72ac0db25	Fix #173, lr cycle default 0 vs 1. Fix #177, mirror resnest weights for future stability.	2020-06-29 21:31:48 -07:00
Ross Wightman	27b3680d49	Revamp LR noise, move logic to scheduler base. Fixup PlateauLRScheduler and add it as an option.	2020-02-22 16:23:15 -08:00
Ross Wightman	aa4354f466	Big re-org, working towards making pip/module as 'timm'	2019-06-19 17:20:51 -07:00