Ross Wightman
8fbd62a169
Exclude batchnorm and bias params from weight_decay by default
2019-04-22 17:33:22 -07:00
Ross Wightman
bc264269c9
Morph mnasnet impl into a generic mobilenet that covers Mnasnet, MobileNetV1/V2, ChamNet, FBNet, and related
...
* add an alternate RMSprop opt that applies eps like TF
* add bn params for passing through alternates and changing defaults to TF style
2019-04-21 15:54:28 -07:00
Ross Wightman
db1fe34d0c
Update a few comment, add some references
2019-04-12 23:16:49 -07:00
Ross Wightman
9c3859fb9c
Uniform pretrained model handling.
...
* All models have 'default_cfgs' dict
* load/resume/pretrained helpers factored out
* pretrained load operates on state_dict based on default_cfg
* test all models in validate
* schedule, optim factor factored out
* test time pool wrapper applied based on default_cfg
2019-04-11 21:32:16 -07:00
Ross Wightman
2295cf56c2
Add some Nvidia performance enhancements (prefetch loader, fast collate), and refactor some of training and model fact/transforms
2019-03-10 14:23:16 -07:00
Ross Wightman
9d927a389a
Add adabound, random erasing
2019-03-01 22:03:42 -08:00
Ross Wightman
5855b07ae0
Initial commit, puting some ol pieces together
2019-02-01 22:07:34 -08:00