Ross Wightman
|
515121cca1
|
Use reshape instead of view in std_conv, causing issues in recent PyTorch in channels_last
|
2021-09-23 15:43:48 -07:00 |
|
Ross Wightman
|
8319e0c373
|
Add file docstring to std_conv.py
|
2021-06-13 12:31:06 -07:00 |
|
Ross Wightman
|
ba2ca4b464
|
One codepath for stdconv, switch layernorm to batchnorm so gain included. Tweak epsilon values for nfnet, resnetv2, vit hybrid.
|
2021-06-12 12:27:43 -07:00 |
|
Ross Wightman
|
8e4ac3549f
|
All ScaledStdConv and StdConv uses default to using F.layernorm so that they work with PyTorch XLA. eps value tweaking is a WIP.
|
2021-06-07 17:14:19 -07:00 |
|
Ross Wightman
|
740f32c96a
|
Add ECA-NFNet-L0 weights and update model name. Update README and bump version to 0.4.6
|
2021-03-17 13:55:32 -07:00 |
|
Ross Wightman
|
8563609b28
|
Update notes in ScaledStdConv impl
|
2021-02-18 12:44:08 -08:00 |
|
Ross Wightman
|
678ba4e0a2
|
Add NFNet-F model weights ported from DeepMind Haiku impl and new set of models w/ compatible config.
|
2021-02-18 12:28:46 -08:00 |
|
Ross Wightman
|
90980de4a9
|
Fix up a few details in NFResNet models, managed stable training. Add support for gamma gain to be applied in activation or ScaleStdConv. Some tweaks to ScaledStdConv.
|
2021-01-30 16:32:07 -08:00 |
|
Ross Wightman
|
5a8e1e643e
|
Initial Normalizer-Free Reg/ResNet impl. A bit of related layer refactoring.
|
2021-01-27 22:06:57 -08:00 |
|