5 Commits

Author	SHA1	Message	Date
Ross Wightman	27b3680d49	Revamp LR noise, move logic to scheduler base. Fixup PlateauLRScheduler and add it as an option.	2020-02-22 16:23:15 -08:00
Ross Wightman	514b0938c4	Experimenting with per-epoch learning rate noise w/ step scheduler	2020-02-21 11:51:05 -08:00
Ross Wightman	fac58f609a	Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. ... * Add some of the trendy new optimizers. Decent results but not clearly better than the standards. * Can create a None scheduler for constant LR * ResNet defaults to zero_init of last BN in residual * add resnet50d config	2019-08-28 00:14:10 -07:00
Ross Wightman	e7c8a37334	Make min-lr and cooldown-epochs cmdline args, change dash in color_jitter arg for consistency	2019-07-26 09:35:31 -07:00
Ross Wightman	aa4354f466	Big re-org, working towards making pip/module as 'timm'	2019-06-19 17:20:51 -07:00