8 Commits

Author	SHA1	Message	Date
Ross Wightman	7dab6d1ec7	Default to img_size in model default_cfg, defer output folder creation until later in the init sequence	2019-06-10 13:34:42 -07:00
Ross Wightman	9bcd65181b	Add exponential moving average for model weights + few other additions and cleanup ... * ModelEma class added to track an EMA set of weights for the model being trained * EMA handling added to train, validation and clean_checkpoint scripts * Add multi checkpoint or multi-model validation support to validate.py * Add syncbn option (APEX) to train script for experimentation * Cleanup interface of CheckpointSaver while adding ema functionality	2019-06-07 15:39:36 -07:00
Ross Wightman	4d2056722a	Mixup and prefetcher improvements ... * Do mixup in custom collate fn if prefetcher enabled, reduces performance impact * Move mixup code to own file * Add arg to disable prefetcher * Fix no cuda transfer when prefetcher off * Random erasing when prefetcher off wasn't changed to match new args, fixed * Default random erasing to off (prob = 0.) for train	2019-05-18 22:17:51 -07:00
Ross Wightman	fee607edf6	Mixup implemention in progress ... * initial impl w/ label smoothing converging, but needs more testing	2019-05-13 19:05:40 -07:00
Ross Wightman	db1fe34d0c	Update a few comment, add some references	2019-04-12 23:16:49 -07:00
Ross Wightman	f1cd1a5ce3	Cleanup CheckpointSaver, add support for increasing or decreasing metric, switch to prec1 metric in train loop	2019-04-07 10:22:55 -07:00
Ross Wightman	a336e5bff3	Minor updates	2019-02-08 20:56:24 -08:00
Ross Wightman	5855b07ae0	Initial commit, puting some ol pieces together	2019-02-01 22:07:34 -08:00