Ross Wightman
|
738a9cd635
|
unbiased=False for torch.var_mean path of ConvNeXt LN. Fix #1090
|
2022-01-17 09:25:06 -08:00 |
|
Ross Wightman
|
e0c4eec4b6
|
Default conv_mlp to False across the board for ConvNeXt, causing issues on more setups than it's improving right now...
|
2022-01-16 14:20:08 -08:00 |
|
Ross Wightman
|
b669f4a588
|
Add ConvNeXt 22k->1k fine-tuned and 384 22k-1k fine-tuned weights after testing
|
2022-01-15 15:44:36 -08:00 |
|
Ross Wightman
|
edd3d73695
|
Add missing dropout for head reset in ConvNeXt default head
|
2022-01-14 16:28:27 -08:00 |
|
Ross Wightman
|
b093dcb46d
|
Some convnext cleanup, remove in place mul_ for gamma, breaking symbolic trace, cleanup head a bit...
|
2022-01-14 16:28:27 -08:00 |
|
Ross Wightman
|
18934debc5
|
Add initial ConvNeXt impl (mods of official code)
|
2022-01-14 16:28:27 -08:00 |
|