10 Commits

Author	SHA1	Message	Date
Ross Wightman	bda8ab015a	Remove min channels for SelectiveKernel, divisor should cover cases well enough.	2021-05-31 15:38:56 -07:00
Ross Wightman	a27f4aec4a	Missed args for skresnext w/ refactoring.	2021-05-31 14:06:34 -07:00
Ross Wightman	307a935b79	Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.	2021-05-31 13:18:11 -07:00
Ross Wightman	110a7c4982	AdaptiveAvgPool2d -> mean((2,3)) for all SE/attn layers to avoid NaN with AMP + channels_last layout. See https://github.com/pytorch/pytorch/issues/43992	2020-09-01 16:05:32 -07:00
Ross Wightman	6c17d57a2c	Fix some attributions, add copyrights to some file docstrings	2020-07-27 13:44:56 -07:00
Ross Wightman	eb7653614f	Monster commit, activation refactor, VoVNet, norm_act improvements, more ... * refactor activations into basic PyTorch, jit scripted, and memory efficient custom auto * implement hard-mish, better grad for hard-swish * add initial VovNet V1/V2 impl, fix #151 * VovNet and DenseNet first models to use NormAct layers (support BatchNormAct2d, EvoNorm, InplaceIABN) * Wrap IABN for any models that use it * make more models torchscript compatible (DPN, PNasNet, Res2Net, SelecSLS) and add tests	2020-06-01 17:16:52 -07:00
Ross Wightman	8d8677e03b	Fix #139. Broken SKResNets after BlurPool addition, as a plus, SKResNets support AA now too.	2020-05-04 12:14:43 -07:00
Ross Wightman	f1d5f8a6c4	Update comments for Selective Kernel and DropBlock/Path impl, add skresnet34 weights	2020-02-18 13:58:30 -08:00
Ross Wightman	569419b38d	Tweak some comments, add SKNet models with weights to sotabench, remove an unused branch	2020-02-15 21:18:25 -08:00
Ross Wightman	a99ec4e7d1	A bunch more layer reorg, splitting many layers into own files. Improve torchscript compatibility.	2020-02-09 14:46:28 -08:00