8 Commits

Author	SHA1	Message	Date
Ross Wightman	b9cfb64412	Support npz custom load for vision transformer hybrid models. Add posembed rescale for npz load.	2021-06-14 12:31:44 -07:00
Ross Wightman	8880f696b6	Refactoring, cleanup, improved test coverage. ... * Add eca_nfnet_l2 weights, 84.7 @ 384x384 * All 'non-std' (ie transformer / mlp) models have classifier / default_cfg test added * Fix #694 reset_classifer / num_features / forward_features / num_classes=0 consistency for transformer / mlp models * Add direct loading of npz to vision transformer (pure transformer so far, hybrid to come) * Rename vit_deit* to deit_* * Remove some deprecated vit hybrid model defs * Clean up classifier flatten for conv classifiers and unusual cases (mobilenetv3/ghostnet) * Remove explicit model fns for levit conv, just pass in arg	2021-06-12 16:40:02 -07:00
Ross Wightman	ba2ca4b464	One codepath for stdconv, switch layernorm to batchnorm so gain included. Tweak epsilon values for nfnet, resnetv2, vit hybrid.	2021-06-12 12:27:43 -07:00
Ross Wightman	8e4ac3549f	All ScaledStdConv and StdConv uses default to using F.layernorm so that they work with PyTorch XLA. eps value tweaking is a WIP.	2021-06-07 17:14:19 -07:00
Ross Wightman	bfc72f75d3	Expand scope of testing for non-std vision transformer / mlp models. Some related cleanup and create fn cleanup for all vision transformer and mlp models. More CoaT weights.	2021-05-24 21:13:26 -07:00
Ross Wightman	288682796f	Update benchmark script to add precision arg. Fix some downstream (DeiT) compat issues with latest changes. Bump version to 0.4.7	2021-04-01 16:40:12 -07:00
Ross Wightman	ea9c9550b2	Fully move ViT hybrids to their own file, including embedding module. Remove some extra DeiT models that were for benchmarking only.	2021-04-01 14:17:38 -07:00
Ross Wightman	a5310a3451	Merge remote-tracking branch 'origin/benchmark-fixes-vit_hybrids' into pit_and_vit_update	2021-04-01 12:15:34 -07:00