1aa617cb3b
Add AvgPool2d anti-aliasing support to ResNet arch (as per OpenAI CLIP models), add a few blur aa models as well
2022-01-18 21:57:24 -08:00
f0f9eccda8
Add --fuser arg to train/validate/benchmark scripts to select jit fuser type
2022-01-17 13:54:25 -08:00
010b486590
Add Dino pretrained weights (no head) for vit models. Add support to tests and helpers for models w/ no classifier (num_classes=0 in pretrained cfg)
2022-01-17 12:20:02 -08:00
738a9cd635
unbiased=False for torch.var_mean path of ConvNeXt LN. Fix #1090
2022-01-17 09:25:06 -08:00
e0c4eec4b6
Default conv_mlp to False across the board for ConvNeXt, causing issues on more setups than it's improving right now...
2022-01-16 14:20:08 -08:00
b669f4a588
Add ConvNeXt 22k->1k fine-tuned and 384 22k-1k fine-tuned weights after testing
2022-01-15 15:44:36 -08:00
e967c72875
Update REAMDE.md. Sneak in g/G (giant / gigantic?) ViT defs from scaling paper
2022-01-14 16:28:27 -08:00
9ca3437178
Add some more small model weights lcnet, mnas, mnv2
2022-01-14 16:28:27 -08:00
fa6463c936
Version 0.5.4
2022-01-14 16:28:27 -08:00
fa81164378
Fix stem width for really small mobilenetv3 arch defs
2022-01-14 16:28:27 -08:00
edd3d73695
Add missing dropout for head reset in ConvNeXt default head
2022-01-14 16:28:27 -08:00
b093dcb46d
Some convnext cleanup, remove in place mul_ for gamma, breaking symbolic trace, cleanup head a bit...
2022-01-14 16:28:27 -08:00
18934debc5
Add initial ConvNeXt impl (mods of official code)
2022-01-14 16:28:27 -08:00
656757d26b
Fix MobileNetV2 head conv size for multiplier < 1.0. Add some missing modification copyrights, fix starting date of some old ones.
2022-01-14 16:28:27 -08:00
ccfeb06936
Fix out_indices handling breakage, should have left as per vgg approach.
2022-01-07 19:30:51 -08:00
a9f91483a6
Fix #1078 , DarkNet has 6 feature maps. Make vgg and darknet out_indices handling/comments equivalent
2022-01-07 15:08:32 -08:00
c21b21660d
visformer supports spatial feat map, update pool_size in pretrained cfg to match
2022-01-07 14:31:43 -08:00
9c11dfd9cb
Fix fbnetv3 pretrained cfg changes
2022-01-07 14:09:50 -08:00
1406cddc2e
FBNetV3 timm trained weights added for b/d/g variants. Update version to 0.5.2 for pypi release.
2022-01-07 12:05:08 -08:00
02ae11e526
Leaving repeat aug sampler indices as tensor thrashes worker shared process memory
2022-01-06 22:33:09 -08:00
4df51f3932
Add lcnet_100 and mnasnet_small weights
2022-01-06 22:21:05 -08:00
5ccf682a8f
Remove deprecated bn-tf train arg and create_model handler. Add evos/evob models back into fx test filter until norm_norm_norm branch merged.
2022-01-06 18:08:39 -08:00
b9a715c86a
Add more small model defs for MobileNetV3/V2/LCNet
2022-01-06 16:06:43 -08:00
b27c21b09a
Update drop_path and drop_block (fast impl) to be symbolically traceable, slightly faster
2022-01-06 16:04:58 -08:00
214c84a235
Disable use of timm nn.Linear wrapper since AMP autocast + torchscript use appears fixed
2022-01-06 16:01:51 -08:00
72b57163d1
Merge branch 'master' of https://github.com/mrT23/pytorch-image-models into mrT23-master
2022-01-06 13:57:16 -08:00
de5fa791c6
Merge branch 'master' into norm_norm_norm
2022-01-03 11:37:00 -08:00
26ff57f953
Add more small model defs for MobileNetV3/V2/LCNet
2022-01-03 11:30:54 -08:00
a0b2657497
Use `torch.repeat_interleave()` to generate repeated indices faster ( #1058 )
...
* update: use numpy to generate repeated indices faster
* update: use torch.repeat_interleave() instead of np.repeat()
* refactor: remove unused import, numpy
* refactor: torch.range to torch.arange
* update: tensor to list before appending the extra samples
* update: concatenate the paddings with torch.cat
2022-01-02 14:01:06 -08:00
450ac6a0f5
Post merge tinynet fixes for pool_size, feature extraction
2021-12-21 23:51:54 -08:00
a04164cd75
Merge branch 'tinynet' of https://github.com/rsomani95/pytorch-image-models into rsomani95-tinynet
2021-12-21 22:45:56 -08:00
8a93ce6ee3
Fix regnetv/w tests, refactor regnet generator code a bit
2021-12-16 17:08:25 -08:00
4dec8c8087
Fix skip path regression for updated EfficientNet and RegNet def. Add Pre-Act RegNet support (experimental). Remove BN-TF flag. Add efficientnet_b0_g8_gn model.
2021-12-16 14:53:57 -08:00
a52a614475
Remove layer experiment which should not have been added
2021-12-14 14:29:32 -08:00
ab49d275de
Significant norm update
...
* ConvBnAct layer renamed -> ConvNormAct and ConvNormActAa for anti-aliased
* Significant update to EfficientNet and MobileNetV3 arch to support NormAct layers and grouped conv (as alternative to depthwise)
* Update RegNet to add Z variant
* Add Pre variant of XceptionAligned that works with NormAct layers
* EvoNorm matches bits_and_tpu branch for merge
2021-12-14 13:48:30 -08:00
31bcd36e46
add tinynet models
2021-12-14 19:34:04 +05:30
b4b8d1ec18
fix hard-coded strides
2021-12-14 17:22:54 +08:00
d04f2f1377
Update drop_path and drop_block (fast impl) to be symbolically traceable, slightly faster
2021-12-05 15:36:56 -08:00
834a9ec721
Disable use of timm nn.Linear wrapper since AMP autocast + torchscript use appears fixed
2021-12-01 14:58:09 -08:00
78912b6375
Updated EvoNorm implementations with some experimentation. Add FilterResponseNorm. Updated RegnetZ and ResNetV2 model defs for trials.
2021-12-01 12:09:01 -08:00
55adfbeb8d
Add commented code to increase open file limit via Python (for TFDS dataset building)
2021-11-30 17:02:27 -08:00
c11f4c3218
support CNNs
2021-11-30 08:48:08 +02:00
d6701d8a81
Merge branch 'rwightman:master' into master
2021-11-30 08:07:44 +02:00
ccb3815360
update arxiv link
2021-11-29 21:41:00 +03:00
3dc71695bf
Merge pull request #989 from martinsbruveris/feat/resmlp-dino
...
Added DINO pretrained ResMLP models.
2021-11-24 09:26:07 -08:00
480c676ffa
Fix FX breaking assert in evonorm
2021-11-24 09:24:47 -08:00
85c5ff26d7
Added DINO pretrained ResMLP models.
2021-11-24 15:02:46 +02:00
d633a014e6
Post merge cleanup. Fix potential security issue passing kwargs directly through to serialized web data.
2021-11-23 16:54:01 -08:00
b18c9e323b
Update helpers.py
2021-11-22 23:43:44 -05:00
308d0b9554
Merge branch 'master' into hf-save-and-push
2021-11-22 23:39:27 -05:00
f0507f6da6
Fix k_decay default arg != 1.0 in poly scheduler
2021-11-22 09:37:36 -08:00
41559247e9
use_ml_decoder_head
2021-11-22 17:50:39 +02:00
1f53db2ece
Updated lamhalobotnet weights, 81.5 top-1
2021-11-21 19:49:51 -08:00
15ef108eb4
Add better halo2botnet50ts weights, 82 top-1 @ 256
2021-11-21 14:09:12 -08:00
734b2244fe
Add RegNetZ-D8 (83.5 @ 256, 84 @ 320) and RegNetZ-E8 (84.5 @ 256, 85 @ 320) weights. Update names of existing RegZ models to include group size.
2021-11-20 15:52:04 -08:00
93cc08fdc5
Make evonorm variables 1d to match other PyTorch norm layers, will break weight compat for any existing use (likely minimal, easy to fix).
2021-11-20 15:50:51 -08:00
af607b75cc
Prep a set of ResNetV2 models with GroupNorm, EvoNormB0, EvoNormS0 for BN free model experiments on TPU and IPU
2021-11-19 17:37:00 -08:00
c976a410d9
Add ResNet-50 w/ GN (resnet50_gn) and SEBotNet-33-TS (sebotnet33ts_256) model defs and weights. Update halonet50ts weights w/ slightly better variant in1k val, more robust to test sets.
2021-11-19 14:24:43 -08:00
f2006b2437
Cleanup qkv_bias cat in beit model so it can be traced
2021-11-18 21:25:00 -08:00
1076a65df1
Minor post FX merge cleanup
2021-11-18 19:47:07 -08:00
32c9937dec
Merge branch 'fx-feature-extract-new' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-fx-feature-extract-new
2021-11-18 16:31:29 -08:00
78b36bf46c
Places365 doesn't exist in some still used torchvision version
2021-11-18 14:59:51 -08:00
65d827c7a6
rename notrace registration and standardize trace_utils imports
2021-11-15 21:03:21 +00:00
9b2daf2a35
Add ResNeXt-50 weights 81.1 top-1 @ 224, 82 @ 288 with A1 'high aug' recipe
2021-11-14 13:17:27 -08:00
9b5d6dc7e2
Merge branch 'add-vit-b8' of https://github.com/martinsbruveris/pytorch-image-models into martinsbruveris-add-vit-b8
2021-11-14 12:54:28 -08:00
cfa414cad2
Matching two bits_and_tpu changes for TFDs wrapper
...
* change 'samples' -> 'examples' for tfds wrapper to match tfds naming
* add class_to_idx for image classification datasets in tfds wrapper
2021-11-14 12:52:19 -08:00
5220711d87
Added B/8 models to ViT.
2021-11-14 11:01:48 +00:00
0262a0e8e1
fx ready for review
2021-11-13 00:06:33 +00:00
d2994016e9
Add try/except guards
2021-11-12 21:16:53 +00:00
b25ff96768
wip - pre-rebase
2021-11-12 20:45:05 +00:00
e051dce354
Make all models FX traceable
2021-11-12 20:45:05 +00:00
cf4561ca72
Add FX based FeatureGraphNet capability
2021-11-12 20:45:05 +00:00
0149ec30d7
wip - attempting to rebase
2021-11-12 20:45:05 +00:00
02c3a75a45
wip - make it possible to use fx graph in train and eval mode
2021-11-12 20:45:05 +00:00
bc3d4eb403
wip -rebase
2021-11-12 20:45:05 +00:00
ab3ac3f25b
Add FX based FeatureGraphNet capability
2021-11-12 20:45:05 +00:00
9ec3210c2d
More TFDS parser cleanup, support improved TFDS even_split impl (on tfds-nightly only currently).
2021-11-10 15:52:09 -08:00
ba65dfe2c6
Dataset work
...
* support some torchvision datasets
* improvements to TFDS wrapper for subsplit handling (fix #942 ), shuffle seed
* add class-map support to train (fix #957 )
2021-11-09 22:34:15 -08:00
ddc29da974
Add ResNet101 and ResNet152 weights from higher aug RSB recipes. 81.93 and 82.82 top-1 at 224x224.
2021-11-02 17:59:16 -07:00
b328e56f49
Update eca_halonext26ts weights to a better set
2021-11-02 16:52:53 -07:00
2ddef942b9
Better fix for #954 that doesn't break torchscript, pull torch._assert into timm namespace when it exists
2021-11-02 11:22:33 -07:00
4f0f9cb348
Fix #954 by bringing traceable _assert into timm to allow compat w/ PyTorch < 1.8
2021-11-02 09:21:40 -07:00
a41de1f666
Add interpolation mode handling to transforms. Removes InterpolationMode warning. Works for torchvision versions w/ and w/o InterpolationMode enum. Fix #738 .
2021-10-28 17:35:01 -07:00
ed41d32637
Add repr to auto_augment and random_erasing impl
2021-10-28 17:33:36 -07:00
ae72d009fa
Add weights for lambda_resnet50ts, halo2botnet50ts, lamhalobotnet50ts, updated halonet50ts
2021-10-27 22:08:54 -07:00
b745d30a3e
Fix formatting of last commit
2021-10-25 15:15:14 -07:00
3478f1d7f1
Traceability fix for vit models for some experiments
2021-10-25 15:13:08 -07:00
f658a72e72
Cleanup re-use of Dropout modules in Mlp modules after some twitter feedback :p
2021-10-25 00:40:59 -07:00
f805ba86d9
use .unbind instead of explicitly listing the indices
2021-10-24 21:08:47 +02:00
57992509f9
Fix some formatting in utils/model.py
2021-10-23 20:35:36 -07:00
0fe4fd3f1f
add d8 and e8 regnetz models with group size 8
2021-10-23 20:34:21 -07:00
25e7c8c5e5
Update broken resnetv2_50 weight url, add resnetv1_101 a1h recipe weights for 224x224 train
2021-10-20 22:14:12 -07:00
b6caa356d2
Fixed eca_botnext26ts_256 weights added, 79.27
2021-10-19 12:44:28 -07:00
c02334d9fa
Add weights for regnetz_d and haloregnetz_c, update regnetz_c weights. Add commented PyTorch XLA code for halo attention
2021-10-19 12:32:09 -07:00
02daf2ab94
Add option to include relative pos embedding in the attention scaling as per references. See discussion #912
2021-10-12 15:37:01 -07:00
047a5ec05f
Fix bugs that Mixup does not work device=cpu
2021-10-12 23:51:46 +09:00
cd34913278
Remove some outdated comments, botnet networks working great now.
2021-10-11 22:43:41 -07:00
6ed4cdccca
Update lambda_resnet26t weights with better set
2021-10-10 16:32:54 -07:00
44d6d51668
Add ConvMixer
2021-10-09 21:09:51 -04:00
a85df34993
Update lambda_resnet26rpt weights to 78.9, add better halonet26t weights at 79.1 with tweak to attention dim
2021-10-08 17:44:13 -07:00
Ross Wightman
Hyeongchan Kim
Rahul Somani
KAI ZHAO
talrid
mrT23
qwertyforce
Ross Wightman
Martins Bruveris
Nathan Raw
Alexander Soare
Thomas Viehmann
masafumi
ICLR Author