4 Commits

Author	SHA1	Message	Date
Alexander Soare	bc3d4eb403	wip -rebase	2021-11-12 20:45:05 +00:00
Ross Wightman	925e102982	Update attention / self-attn based models from a series of experiments: ... * remove dud attention, involution + my swin attention adaptation don't seem worth keeping * add or update several new 26/50 layer ResNe(X)t variants that were used in experiments * remove models associated with dead-end or uninteresting experiment results * weights coming soon...	2021-08-20 16:13:11 -07:00
Ross Wightman	0721559511	Improved (hopefully) init for SA/SA-like layers used in ByoaNets	2021-05-04 21:40:39 -07:00
Ross Wightman	9cc7dda6e5	Fixup byoanet configs to pass unit tests. Add swin_attn and swinnet26t model for testing.	2021-04-29 21:08:37 -07:00