6 Commits

Author	SHA1	Message	Date
Ross Wightman	4b30bae67b	Add updated vit_relpos weights, and impl w/ support for official swin-v2 differences for relpos. Add bias control support for MLP layers	2022-05-13 13:53:57 -07:00
Ross Wightman	f658a72e72	Cleanup re-use of Dropout modules in Mlp modules after some twitter feedback :p	2021-10-25 00:40:59 -07:00
Ross Wightman	8880f696b6	Refactoring, cleanup, improved test coverage. ... * Add eca_nfnet_l2 weights, 84.7 @ 384x384 * All 'non-std' (ie transformer / mlp) models have classifier / default_cfg test added * Fix #694 reset_classifer / num_features / forward_features / num_classes=0 consistency for transformer / mlp models * Add direct loading of npz to vision transformer (pure transformer so far, hybrid to come) * Rename vit_deit* to deit_* * Remove some deprecated vit hybrid model defs * Clean up classifier flatten for conv classifiers and unusual cases (mobilenetv3/ghostnet) * Remove explicit model fns for levit conv, just pass in arg	2021-06-12 16:40:02 -07:00
Ross Wightman	742c2d5247	Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.	2021-05-27 18:03:29 -07:00
Ross Wightman	d5af752117	Add preliminary gMLP and ResMLP impl to Mlp-Mixer	2021-05-19 09:55:05 -07:00
Ross Wightman	b2c305c2aa	Move Mlp and PatchEmbed modules into layers. Being used in lots of models now...	2021-05-06 14:03:23 -07:00