Richard Chen
7ab9d4555c
add crossvit
2021-09-01 17:13:12 -04:00
Ross Wightman
fc894c375c
Another attempt at sgd momentum test passing...
2021-08-27 10:39:31 -07:00
Ross Wightman
708d87a813
Fix ViT SAM weight compat as weights at URL changed to not use repr layer. Fix #825 . Tweak optim test.
2021-08-27 09:20:13 -07:00
Ross Wightman
c207e02782
MOAR optimizer changes. Woo!
2021-08-18 22:20:35 -07:00
Ross Wightman
42c1f0cf6c
Fix lars tests
2021-08-18 21:05:34 -07:00
Ross Wightman
a426511c95
More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.
2021-08-18 17:21:56 -07:00
Ross Wightman
a6af48be64
add madgradw optimizer
2021-08-17 22:19:27 -07:00
Ross Wightman
55fb5eedf6
Remove experiment from lamb impl
2021-08-17 21:48:26 -07:00
Ross Wightman
959eaff121
Add optimizer tests and update testing to pytorch 1.9
2021-08-17 17:59:15 -07:00
Ross Wightman
01cb46a9a5
Add gc_efficientnetv2_rw_t weights (global context instead of SE attn). Add TF XL weights even though the fine-tuned ones don't validate that well. Change default arg for GlobalContext to use scal (mul) mode.
2021-08-07 16:45:29 -07:00
Ross Wightman
ef1e2e12be
Attempt to fix xcit test failures on github runner by filter largest models
2021-07-13 16:33:55 -07:00
Alexander Soare
623e8b8eb8
wip xcit
2021-07-11 09:39:38 +01:00
Alexander Soare
7b8a0017f1
wip to review
2021-07-03 12:10:12 +01:00
Ross Wightman
b41cffaa93
Fix a few issues loading pretrained vit/bit npz weights w/ num_classes=0 __init__ arg. Missed a few other small classifier handling detail on Mlp, GhostNet, Levit. Should fix #713
2021-06-22 23:16:05 -07:00
Ross Wightman
381b279785
Add hybrid model fwds back
2021-06-19 22:28:44 -07:00
Ross Wightman
0020268d9b
Try lower max size for non_std default_cfg test
2021-06-12 23:31:24 -07:00
Ross Wightman
8880f696b6
Refactoring, cleanup, improved test coverage.
...
* Add eca_nfnet_l2 weights, 84.7 @ 384x384
* All 'non-std' (ie transformer / mlp) models have classifier / default_cfg test added
* Fix #694 reset_classifer / num_features / forward_features / num_classes=0 consistency for transformer / mlp models
* Add direct loading of npz to vision transformer (pure transformer so far, hybrid to come)
* Rename vit_deit* to deit_*
* Remove some deprecated vit hybrid model defs
* Clean up classifier flatten for conv classifiers and unusual cases (mobilenetv3/ghostnet)
* Remove explicit model fns for levit conv, just pass in arg
2021-06-12 16:40:02 -07:00
Ross Wightman
17dc47c8e6
Missed comma in test filters.
2021-05-30 22:00:43 -07:00
Ross Wightman
8bf63b6c6c
Able to use other attn layer in EfficientNet now. Create test ECA + GC B0 configs. Make ECA more configurable.
2021-05-30 12:47:02 -07:00
Ross Wightman
9c78de8c02
Fix #661 , move hardswish out of default args for LeViT. Enable native torch support for hardswish, hardsigmoid, mish if present.
2021-05-26 15:28:42 -07:00
Ross Wightman
5db7452173
Fix visformer in_chans stem handling
2021-05-25 14:11:36 -07:00
Ross Wightman
fd92ba0de8
Filter large vit models from torchscript tests
2021-05-25 12:52:07 -07:00
Ross Wightman
99d97e0d67
Hopefully the last test update for this PR...
2021-05-25 11:10:17 -07:00
Ross Wightman
d400f1dbdd
Filter test models before creation for backward/torchscript tests
2021-05-25 10:14:45 -07:00
Ross Wightman
c4572cc5aa
Add Visformer-small weighs, tweak torchscript jit test img size.
2021-05-24 22:50:12 -07:00
Ross Wightman
83487e2a0d
Lower max backward size for tests.
2021-05-24 21:36:56 -07:00
Ross Wightman
bfc72f75d3
Expand scope of testing for non-std vision transformer / mlp models. Some related cleanup and create fn cleanup for all vision transformer and mlp models. More CoaT weights.
2021-05-24 21:13:26 -07:00
Ross Wightman
f45de37690
Merge branch 'master' into levit_visformer_rednet
2021-05-22 16:34:31 -07:00
Ross Wightman
306c86b668
Merge branch 'convit' of https://github.com/amaarora/pytorch-image-models into amaarora-convit
2021-05-21 16:27:10 -07:00
Aman Arora
50d6aab0ef
Add convit to non-std filters as vit_
2021-05-21 03:46:47 +00:00
Aman Arora
1633317489
update tests and exclude convit_base
2021-05-21 01:11:56 +00:00
李鑫杰
d046498e0b
update test_models.py
2021-05-20 11:20:39 +08:00
Ross Wightman
6d81374b88
Update tests for new mlp models
2021-05-19 11:09:42 -07:00
Ross Wightman
ecc7552c5c
Add levit, levit_c, and visformer model defs. Largely untested and not finished cleanup.
2021-05-14 17:16:34 -07:00
Ross Wightman
d45e50b9db
Update test for cait 448x448 model
2021-05-05 17:51:23 -07:00
Ross Wightman
5fcddb96a8
Merge branch 'master' into cait
2021-05-05 17:29:38 -07:00
Ross Wightman
2d8b09fe8b
Add official pretrained weights to MLP-Mixer, complete model cfgs.
2021-05-05 15:59:40 -07:00
Ross Wightman
1daa15ecc3
Initial Cait commit. Still some cleanup to do.
2021-05-04 11:19:27 -07:00
Ross Wightman
67d0665b46
Post ResNet-RS merge cleanup. Add weight urls, adjust train/test/crop pct.
2021-05-04 11:04:23 -07:00
Aman Arora
560eae38f5
[WIP] Add ResNet-RS models ( #554 )
...
* Add ResNet-RS models
* Only include resnet-rs changes
* remove whitespace diff
* EOF newline
* Update time
* increase time
* Add first conv
* Try running only resnetv2_101x1_bitm on Linux runner
* Add to exclude filter
* Run test_model_forward_features for all
* Add to exclude ftrs
* back to defaults
* only run test_forward_features
* run all tests
* Run all tests
* Add bigger resnetrs to model filters to fix Github CLI
* Remove resnetv2_101x1_bitm from exclude feat features
* Remove hardcoded values
* Make sure reduction ratio in resnetrs is 0.25
* There is no bias in replaced maxpool so remove it
2021-05-04 10:59:44 -07:00
morizin
06841427cd
Add files via upload
2021-04-24 18:11:28 +05:30
Ross Wightman
d793deb51a
Merge branch 'master' of https://github.com/iamhankai/pytorch-image-models into iamhankai-master
2021-04-15 09:30:25 -07:00
Ross Wightman
277a9a78f9
Fix unit test filter update.
2021-04-13 22:15:20 -07:00
Ross Wightman
858728799c
Update README again. Add 101x3 BiT-M model to CI ignore since it's starting to fail in GitHub runners.
2021-04-13 13:36:24 -07:00
Ross Wightman
f606c45c38
Add Swin Transformer models from https://github.com/microsoft/Swin-Transformer
2021-04-13 12:17:21 -07:00
iamhankai
de445e7827
Add GhostNet
2021-04-13 23:19:51 +08:00
Ross Wightman
16f7aa9f54
Add default_cfg options for min_input_size / fixed_input_size, queries in model registry, and use for testing self-attn models
2021-04-12 11:54:22 -07:00
Ross Wightman
2b49ab7a36
Fix ResNetV2 pretrained classifier issue. Fixes #540
2021-04-03 11:18:12 -07:00
Ross Wightman
0dfc5a66bb
Add PiT model from https://github.com/naver-ai/pit
2021-03-31 18:20:14 -07:00
Ross Wightman
51febd869b
Small tweak to tests for tnt model, reorder model imports.
2021-03-29 11:33:08 -07:00
contrastive
809271b0f3
Update test_models.py
2021-03-29 09:39:50 +08:00
Ross Wightman
317ea3e599
Tweak NFNet, ResNetV2, RexNet feature extraction, use pre-act features for simplicty. Update tests for pytorch 1.8. 0.4.5 version bump.
2021-03-06 12:48:06 -08:00
Ross Wightman
da4839530c
Fix test model filter to include dm_ variants that break GitHub CI limits
2021-02-18 13:43:04 -08:00
Ross Wightman
0d253e2c5e
Fix issue with nfnet tests, bit more cleanup.
2021-02-12 21:05:41 -08:00
Ross Wightman
9811e229f7
Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.
2021-02-09 16:22:52 -08:00
Ross Wightman
55f7dfa9ea
Refactor vision_transformer entrpy fns, add pos embedding resize support for fine tuning, add some deit models for testing
2021-01-18 16:11:02 -08:00
Ross Wightman
0a1668f63e
Update tests
2021-01-16 12:37:10 -08:00
Ross Wightman
20516abc18
Fix some broken tests for ResNetV2 BiT models
2021-01-04 23:21:39 -08:00
Ross Wightman
2ed8f24715
A few more changes for 0.3.2 maint release. Linear layer change for mobilenetv3 and inception_v3, support no bias for linear wrapper.
2020-11-30 16:19:52 -08:00
Ross Wightman
da6cd2cc1f
Fix regression for pretrained classifier loading when using entrypt functions directly
2020-10-29 15:43:39 -07:00
Ross Wightman
be53107e8a
Update README, ensure vit excluded from all tests (not ready)
2020-10-13 14:51:08 -07:00
Ross Wightman
f31933cb37
Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.
2020-10-13 13:33:44 -07:00
Ross Wightman
90a01f47d1
hrnet features_only pretrained weight loading issue. Fix #232 .
2020-09-01 17:37:55 -07:00
Ross Wightman
470220b1f4
Fix MobileNetV3 crash with global_pool='', output consistent with other models but not equivalent due to efficient head.
2020-08-18 14:11:30 -07:00
Ross Wightman
b1b6e7c361
Fix a few more issues related to #216 w/ TResNet (space2depth) and FP16 weights in wide resnets. Also don't completely dump pretrained weights in in_chans != 1 or 3 cases.
2020-08-11 18:57:47 -07:00
Yusuke Uchida
e717250ed4
remove comments
2020-08-11 23:33:22 +09:00
Yusuke Uchida
f6b56602f9
fix test_model_default_cfgs
2020-08-11 23:23:57 +09:00
Ross Wightman
d5145fa4d5
Change default_cfg names for senet to include the legacy and match model names
2020-08-08 11:12:58 -07:00
Ross Wightman
b1f1a54de9
More uniform treatment of classifiers across all models, reduce code duplication.
2020-08-03 22:18:24 -07:00
Ross Wightman
d72ddafe56
Fix some checkpoint / model str regressions
2020-07-29 19:43:01 -07:00
Ross Wightman
ea58e0bc16
Disable big models for MacOS test since they are starting to fail frequently.
2020-07-27 18:01:43 -07:00
Ross Wightman
7ba5a384d3
Add ReXNet w/ remapped weights, feature support
2020-07-23 10:28:57 -07:00
Ross Wightman
c9d54bc1c3
Add HRNet feature extraction, fix senet type, lower feature testing res to 96x96
2020-07-21 17:39:29 -07:00
Ross Wightman
2ac663f340
Add feature support to legacy senets, add 32x32 resnext models to exclude list for feature testing.
2020-07-21 11:15:30 -07:00
Ross Wightman
4e61c6a12d
Cleanup, refactoring of Feature extraction code, add tests, fix tests, non hook feature extraction working with torchscript
2020-07-20 16:10:31 -07:00
Ross Wightman
9eba134d79
More models supporting feature extraction, xception, gluon_xception, inception_v3, inception_v4, pnasnet, nasnet, dla. Fix DLA unused projection params.
2020-07-19 14:02:02 -07:00
Ross Wightman
151679c2f1
Add custom grad tests, fix cut & paste error with hard_mish ME, add a few more pytorch act fns to factory
2020-06-11 14:49:23 -07:00
Ross Wightman
eb7653614f
Monster commit, activation refactor, VoVNet, norm_act improvements, more
...
* refactor activations into basic PyTorch, jit scripted, and memory efficient custom auto
* implement hard-mish, better grad for hard-swish
* add initial VovNet V1/V2 impl, fix #151
* VovNet and DenseNet first models to use NormAct layers (support BatchNormAct2d, EvoNorm, InplaceIABN)
* Wrap IABN for any models that use it
* make more models torchscript compatible (DPN, PNasNet, Res2Net, SelecSLS) and add tests
2020-06-01 17:16:52 -07:00
Ross Wightman
4d13db538f
Add x48d ResNext101s to test exclude for ubuntu
2020-05-21 19:13:41 -07:00
Ross Wightman
4212cd3b9f
Another attempt at getting Ubuntu test runner to work
2020-05-21 18:55:10 -07:00
Ross Wightman
20329f2630
Bring down test resolutions to see if we can at least do a fwd on the L2 models
2020-05-21 16:49:46 -07:00
Ross Wightman
3873ea710e
Minor test change
2020-05-21 15:51:47 -07:00
Ross Wightman
afb6bd0669
Add backward and default_cfg tests and fix a few issues found. Fix #153
2020-05-21 15:30:58 -07:00
Ross Wightman
5bd1ad13e7
Refactor test indent
2020-05-12 13:07:46 -07:00
Ross Wightman
9cc289f18c
Exclude EfficientNet-L2 models from test
2020-05-12 13:07:03 -07:00
Ross Wightman
e545bb9401
Update test_inference.py
...
Not six min
2020-05-07 10:15:49 -07:00
Ross Wightman
305a2db705
Update test_inference.py
...
Make the timeout 5-min for now, see if we can get a pass...
2020-05-07 10:14:24 -07:00
michal
69d725c9fe
Basic forward pass test for all registered models
2020-05-07 00:20:58 -04:00