Ross Wightman
|
cb3f9c23bb
|
Metaformer baselines for vision (final PR with cleanup) (#1793)
* update
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* merge with poolformer, initial version
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Revert "Update metaformers.py"
This reverts commit 2916f37f8d.
* Revert "Update metaformers.py"
This reverts commit 1d882eb494.
* Revert "Update metaformers.py"
This reverts commit 2209d0830e.
* Revert "Update metaformers.py"
This reverts commit 32bede4e27.
* Revert "Update metaformers.py"
This reverts commit 4ed934e000.
* Revert "Update metaformers.py"
This reverts commit 3f0b075367.
* Revert "Update metaformers.py"
This reverts commit 2fef9006d7.
* Update metaformers.py
* Update metaformers.py
* rename model
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Stem/Downsample rework
* Update metaformers.py
* try NHWC
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Squashed commit of the following:
commit b7696a30a7
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Fri Feb 10 01:46:44 2023 -0800
Update metaformers.py
commit 41fe5c3626
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Fri Feb 10 01:03:47 2023 -0800
Update metaformers.py
commit a3aee37c35
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Fri Feb 10 00:32:04 2023 -0800
Update metaformers.py
commit f938beb81b
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Fri Feb 10 00:24:58 2023 -0800
Update metaformers.py
commit 10bde717e5
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Sun Feb 5 02:11:28 2023 -0800
Update metaformers.py
commit 39274bd45e
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Sun Feb 5 02:06:58 2023 -0800
Update metaformers.py
commit a2329ab8ec
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Sun Feb 5 02:03:34 2023 -0800
Update metaformers.py
commit 53b8ce5b8a
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Sun Feb 5 02:02:37 2023 -0800
Update metaformers.py
commit ab6225b941
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Sun Feb 5 01:04:55 2023 -0800
try NHWC
commit 02fcc30eaa
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Sat Feb 4 23:47:06 2023 -0800
Update metaformers.py
commit 366aae9304
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Sat Feb 4 23:37:30 2023 -0800
Stem/Downsample rework
commit 26a8e481a5
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Wed Feb 1 07:42:07 2023 -0800
Update metaformers.py
commit a913f5d438
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Wed Feb 1 07:41:24 2023 -0800
Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* channels first for whole network
* Channels first
* Update metaformers.py
* Use buffer for randformer
* Update metaformers.py
* Remove einsum
* don't test randformer for feature extraction
* arbitrary input sizes for randformer
* Squashed commit of the following:
commit 6c089ca4325ab10942fe56e0999dcc1a11e1d2f0
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Mon Mar 6 02:11:17 2023 -0800
Update metaformers.py
commit 521528a900e49ef8f462f5ccd795efb3a5d14214
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Mon Mar 6 02:06:08 2023 -0800
Update metaformers.py
commit 3827eec7963698ff727fbb13ace53594ceb374d5
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Mon Mar 6 02:03:08 2023 -0800
Update metaformers.py
commit ac1c6fea8adcd846e031ea0f5fa81ffe63d3c4bb
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Mon Mar 6 02:01:04 2023 -0800
Update metaformers.py
commit 26f3d343cdc46183543f83482187f669f3181ddf
Merge: d577129 f736730
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Mon Mar 6 01:57:29 2023 -0800
Merge branch 'metaformer_workspace' of https://github.com/fffffgggg54/pytorch-image-models into metaformer_workspace
commit d577129aaa23fb348a8bb93bcd17cf1d5a4e8ff8
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Mon Mar 6 01:57:20 2023 -0800
Update metaformers.py
commit f7367304e8f3b7a9a7f16e0a032bb72546afcc2a
Author: Fredo Guan <fredo.guan@hotmail.com>
Date: Mon Mar 6 01:56:11 2023 -0800
Metaformer baselines for vision (#12)
* formatting, cleanup, fix dropout
* fix regression, pass kwargs
* fix poolformerv1 weights, formatting
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* Update metaformers.py
* some cleanup
* SDPA from ViT, fix imports
* Update metaformers.py
* fix head reset
* fast norm bias patch for metaformers
* Metaformer refactor, remove rand/ident models, fix issues, remove old poolformer
* Switch to hub weights
---------
Co-authored-by: Fredo Guan <fredo.guan@hotmail.com>
|
2023-05-05 11:18:26 -07:00 |
Ross Wightman
|
8fa86a28a8
|
Add datacomp L/14 (79.2 zs) image tower weights
|
2023-05-01 10:24:08 -07:00 |
|
Ross Wightman
|
5e64777804
|
0.8.21dev0
|
2023-04-28 13:46:59 -07:00 |
|
Ross Wightman
|
51b262e250
|
Update README.md
|
2023-04-27 16:20:18 -07:00 |
|
Ross Wightman
|
bd5f9a341f
|
Merge pull request #1789 from huggingface/mw-final
Final push to get remaining models using multi-weight pretrained configs and HF hub weights
|
2023-04-27 13:01:32 -07:00 |
|
Ross Wightman
|
493c730ffc
|
Fix pit regression
|
2023-04-26 23:16:06 -07:00 |
|
Ross Wightman
|
437d344e03
|
Always some torchscript issues
|
2023-04-26 20:42:34 -07:00 |
|
Ross Wightman
|
528faa0e04
|
Some fixes
|
2023-04-26 17:46:20 -07:00 |
|
Ross Wightman
|
3386af8c86
|
Final push to get remaining models using multi-weight pretrained configs, almost all weights on HF hub
|
2023-04-26 15:52:13 -07:00 |
|
Ross Wightman
|
9ee846ff0c
|
Update README.md
|
2023-04-21 17:58:26 -07:00 |
|
Ross Wightman
|
c0560cbf22
|
version 0.8.20dev0
|
2023-04-21 16:57:32 -07:00 |
|
Ross Wightman
|
7ad7ddb7ad
|
DenseNet, DPN, VoVNet, Aligned Xception weights on HF hub. DenseNet grad_checkpointing using timm API
|
2023-04-21 16:56:44 -07:00 |
|
Ross Wightman
|
864bfd43d0
|
hardcore nas weights on hf hub
|
2023-04-21 14:35:10 -07:00 |
|
Ross Wightman
|
6e4529ae35
|
TResNet weights now on HF hub, modified to remove InplaceABN dependency
|
2023-04-21 14:20:48 -07:00 |
|
Ross Wightman
|
46df4fe633
|
Merge pull request #1785 from huggingface/mw-more
More models w/ multi-weight support, adding to HF hub
|
2023-04-21 09:19:04 -07:00 |
|
Ross Wightman
|
04dcbc02ec
|
Fix weight remap for tresnet_v2_l
|
2023-04-21 09:05:04 -07:00 |
|
Ross Wightman
|
a08e5aed1d
|
More models w/ multi-weight support, moving to HF hub. Removing inplace_abn from all models including TResNet
|
2023-04-20 22:44:49 -07:00 |
|
Ross Wightman
|
2aabaef039
|
Merge pull request #1784 from huggingface/wip-voidbag-accumulate-grad
Accumulate gradients (adding to #1659)
|
2023-04-20 08:15:28 -07:00 |
|
Ross Wightman
|
a83e9f2d3b
|
forward & backward in same no_sync context, slightly easier to read that splitting
|
2023-04-20 08:14:05 -07:00 |
|
Ross Wightman
|
f4825a09ef
|
Merge pull request #212 from bryant1410/patch-1
Fix MultiEpochsDataLoader when there's no batching
|
2023-04-20 07:09:27 -07:00 |
|
Ross Wightman
|
4cd7fb88b2
|
clip gradients with update
|
2023-04-19 23:36:20 -07:00 |
|
Ross Wightman
|
df81d8d85b
|
Cleanup gradient accumulation, fix a few issues, a few other small cleanups in related code.
|
2023-04-19 23:11:00 -07:00 |
|
Ross Wightman
|
ab7ca62a6e
|
Merge branch 'main' of github.com:rwightman/pytorch-image-models into wip-voidbag-accumulate-grad
|
2023-04-19 11:08:12 -07:00 |
|
Ross Wightman
|
ec6cca4b37
|
Add head-init-scale and head-init-bias args that works for all models, fix #1718
|
2023-04-14 17:59:23 -07:00 |
|
Ross Wightman
|
34df125be6
|
cait, volo, xvit hub weights
|
2023-04-14 10:13:13 -07:00 |
|
Ross Wightman
|
f6d5767551
|
cspnet models on HF hub w/ multi-weight support
|
2023-04-12 14:02:38 -07:00 |
|
Ross Wightman
|
21b1c2f6a1
|
Update README.md
|
2023-04-12 09:24:35 -07:00 |
|
Ross Wightman
|
3bd35c7004
|
Merge pull request #1766 from huggingface/onnx_export
Add long missing onnx utils and export code
|
2023-04-12 09:06:16 -07:00 |
|
Ross Wightman
|
aef6e562e4
|
Add onnx utils and export code, tweak padding and conv2d_same for better dynamic export with recent PyTorch
|
2023-04-11 17:03:57 -07:00 |
|
Ross Wightman
|
80b247d843
|
Update swin_v2 attn_mask buffer change in #1790 to apply to updated checkpoints in hub
|
2023-04-11 14:40:32 -07:00 |
|
Ross Wightman
|
1a1aca0cee
|
Merge pull request #1761 from huggingface/patch_drop_refactor
Implement patch dropout for eva / vision_transformer, refactor dropout args
|
2023-04-11 14:37:36 -07:00 |
|
Ross Wightman
|
5fa53c5f31
|
Merge pull request #1760 from MarcoForte/patch-1
skip SwinV2 attention mask buffers
|
2023-04-11 14:37:02 -07:00 |
|
Ross Wightman
|
c0670822d2
|
Small factory handling fix for pretrained tag vs cfg
|
2023-04-11 07:42:13 -07:00 |
|
Ross Wightman
|
2f25f73b90
|
Missed a fused_attn update in relpos vit
|
2023-04-10 23:30:50 -07:00 |
|
Ross Wightman
|
0b65b5c0ac
|
Add finalized eva CLIP weights pointing to remapped timm hub models
|
2023-04-10 23:13:12 -07:00 |
|
Ross Wightman
|
965d0a2d36
|
fast_attn -> fused_attn, implement global config for enable/disable fused_attn, add to more models. vit clip openai 336 weights.
|
2023-04-10 12:04:33 -07:00 |
|
Ross Wightman
|
4d135421a3
|
Implement patch dropout for eva / vision_transformer, refactor / improve consistency of dropout args across all vit based models
|
2023-04-07 20:27:23 -07:00 |
Marco Forte
|
c76818a592
|
skip attention mask buffers
Allows more flexibility in the resolutions accepted by SwinV2.
|
2023-04-07 18:50:02 +02:00 |
|
Ross Wightman
|
1bb3989b61
|
Improve kwarg passthrough for swin, vit, deit, beit, eva
|
2023-04-05 21:37:16 -07:00 |
|
Ross Wightman
|
a09e240cd6
|
Merge pull request #1756 from huggingface/mw-resnet
ResNet models on HF hub, multi-weight support
|
2023-04-05 17:42:48 -07:00 |
|
Ross Wightman
|
35c94b836c
|
Update warning message for deprecated model names
|
2023-04-05 17:24:17 -07:00 |
|
Ross Wightman
|
9eaab795c2
|
Add some vit model deprecations
|
2023-04-05 17:21:03 -07:00 |
|
Ross Wightman
|
b17abd35b2
|
Version 0.8.19dev0
|
2023-04-05 16:37:16 -07:00 |
|
Ross Wightman
|
647ba98d23
|
Update README
|
2023-04-05 16:37:07 -07:00 |
|
Ross Wightman
|
abff3f12ec
|
Wrong pool_size for 288 ft
|
2023-04-05 16:07:51 -07:00 |
|
Ross Wightman
|
356309959c
|
ResNet models on HF hub, multi-weight support, add torchvision v2 weights, new 12k pretrained and fine-tuned timm anti-aliased weights
|
2023-04-05 14:19:42 -07:00 |
|
Ross Wightman
|
7501972cd6
|
Version 0.8.18dev0
|
2023-03-31 16:51:26 -07:00 |
|
Ross Wightman
|
a84bf11887
|
Update README
|
2023-03-31 16:51:02 -07:00 |
|
Ross Wightman
|
beef7f0a22
|
Add ImageNet-12k intermediate fine-tunes of convnext base & large CLIP models, add first 1k fine-tune of xxlarge
|
2023-03-31 16:45:01 -07:00 |
|
Ross Wightman
|
9aa1133bd2
|
Fix #1750, uncomment weight that exists on HF hub, add FIXME to 3 others that are still on local storage
|
2023-03-31 14:49:30 -07:00 |