7 Commits

Author	SHA1	Message	Date
Ross Wightman	5f81d4de23	Move DeiT to own file, vit getting crowded. Working towards fixing #1029, make pooling interface for transformers and mlp closer to convnets. Still working through some details...	2022-01-26 22:53:57 -08:00
Ross Wightman	738a9cd635	unbiased=False for torch.var_mean path of ConvNeXt LN. Fix #1090	2022-01-17 09:25:06 -08:00
Ross Wightman	e0c4eec4b6	Default conv_mlp to False across the board for ConvNeXt, causing issues on more setups than it's improving right now...	2022-01-16 14:20:08 -08:00
Ross Wightman	b669f4a588	Add ConvNeXt 22k->1k fine-tuned and 384 22k-1k fine-tuned weights after testing	2022-01-15 15:44:36 -08:00
Ross Wightman	edd3d73695	Add missing dropout for head reset in ConvNeXt default head	2022-01-14 16:28:27 -08:00
Ross Wightman	b093dcb46d	Some convnext cleanup, remove in place mul_ for gamma, breaking symbolic trace, cleanup head a bit...	2022-01-14 16:28:27 -08:00
Ross Wightman	18934debc5	Add initial ConvNeXt impl (mods of official code)	2022-01-14 16:28:27 -08:00