Commit Graph

1037 Commits (a16a7538529e8f0e196257a708852ab9ea6ff997)
 

Author SHA1 Message Date
Ross Wightman 742c2d5247 Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy. 2021-05-27 18:03:29 -07:00
Ross Wightman 9c78de8c02 Fix #661, move hardswish out of default args for LeViT. Enable native torch support for hardswish, hardsigmoid, mish if present. 2021-05-26 15:28:42 -07:00
Ross Wightman 07d952c7a7
Merge pull request #637 from rwightman/levit_visformer_rednet
LeVit, Visformer, RedNet/Involution models and layers
2021-05-25 14:27:06 -07:00
Ross Wightman 7f368782b7
Merge pull request #660 from petervandenabeele/readme_fix_typos
README: fix simple typos
2021-05-25 14:26:51 -07:00
Ross Wightman 5db7452173 Fix visformer in_chans stem handling 2021-05-25 14:11:36 -07:00
Peter Vandenabeele 51c432150a README: fix simple typos 2021-05-25 22:43:54 +02:00
Ross Wightman fd92ba0de8 Filter large vit models from torchscript tests 2021-05-25 12:52:07 -07:00
Ross Wightman 318360c3f9 Update README.md before merge. Bump version to 0.4.10 2021-05-25 12:26:16 -07:00
Ross Wightman 99d97e0d67 Hopefully the last test update for this PR... 2021-05-25 11:10:17 -07:00
Ross Wightman 11ae795e99 Redo LeViT attention bias caching in a way that works with both torchscript and DataParallel 2021-05-25 10:15:32 -07:00
Ross Wightman d400f1dbdd Filter test models before creation for backward/torchscript tests 2021-05-25 10:14:45 -07:00
Ross Wightman c4572cc5aa Add Visformer-small weighs, tweak torchscript jit test img size. 2021-05-24 22:50:12 -07:00
Ross Wightman 83487e2a0d Lower max backward size for tests. 2021-05-24 21:36:56 -07:00
Ross Wightman bfc72f75d3 Expand scope of testing for non-std vision transformer / mlp models. Some related cleanup and create fn cleanup for all vision transformer and mlp models. More CoaT weights. 2021-05-24 21:13:26 -07:00
Ross Wightman 18bf520ad1 Add eca_nfnet_l2/l3 defs for future training 2021-05-22 21:55:37 -07:00
Ross Wightman f45de37690 Merge branch 'master' into levit_visformer_rednet 2021-05-22 16:34:31 -07:00
Ross Wightman 23c18a33e4 Add efficientnetv2_rw_m weights trained in PyTorch. 84.8 top-1 @ 416 test. 53M params. 2021-05-21 21:16:25 -07:00
Ross Wightman c2ba229d99 Prep for effcientnetv2_rw_m model weights that started training before official release.. 2021-05-21 17:47:49 -07:00
Ross Wightman 22f7c6760f Merge branch 'alexander-soare-master' 2021-05-21 17:21:40 -07:00
Ross Wightman 30b9880d06 Minor adjustment, mutable default arg, extra check of valid len... 2021-05-21 17:20:51 -07:00
Ross Wightman be0abfbcce Merge branch 'master' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-master 2021-05-21 17:10:11 -07:00
Ross Wightman d4c00d6150 Merge branch 'amaarora-convit' 2021-05-21 17:04:56 -07:00
Ross Wightman b7de82e835 ConViT cleanup, fix torchscript, bit of reformatting, reuse existing layers. 2021-05-21 17:04:23 -07:00
Ross Wightman 306c86b668 Merge branch 'convit' of https://github.com/amaarora/pytorch-image-models into amaarora-convit 2021-05-21 16:27:10 -07:00
Ross Wightman 6e04da0c54 Merge branch 'abcdvzz-master' 2021-05-21 16:24:46 -07:00
Ross Wightman a569635045 Update twin weights to a copy in GitHub releases for faster dl. Tweak model class comment. 2021-05-21 16:23:14 -07:00
Ross Wightman be99eef9c1 Remove redundant code, cleanup, fix torchscript. 2021-05-20 23:38:35 -07:00
Ross Wightman 5ab372a3ec Merge branch 'master' of https://github.com/abcdvzz/pytorch-image-models into abcdvzz-master 2021-05-20 23:37:50 -07:00
Aman Arora 50d6aab0ef Add convit to non-std filters as vit_ 2021-05-21 03:46:47 +00:00
Aman Arora 5db1eb6ba5 Add defaults 2021-05-21 02:11:20 +00:00
Aman Arora 9b97753f9c Merge branch 'convit' of https://github.com/amaarora/pytorch-image-models into convit 2021-05-21 01:12:10 +00:00
Aman Arora 1633317489 update tests and exclude convit_base 2021-05-21 01:11:56 +00:00
Aman Arora 8b1f2e8e1f remote unused matplotlib import 2021-05-20 23:42:42 +00:00
Aman Arora 40c506ba1e Add ConViT 2021-05-20 23:17:28 +00:00
Ross Wightman b4ebf9263e
Merge pull request #651 from mrT23/master
mixer_b16_224 with miil pretraining
2021-05-20 07:55:38 -07:00
Alexander Soare 7976019864 extend positional embedding resizing functionality to tnt 2021-05-20 11:55:48 +01:00
Alexander Soare 8086943b6f allow resize positional embeddings to non-square grid 2021-05-20 11:27:58 +01:00
talrid dc1a4efd28 mixer_b16_224_miil, mixer_b16_224_miil_in21k models 2021-05-20 10:35:50 +03:00
mrT23 709d7c07e8 Merge branch 'rwightman:master' into master 2021-05-20 10:23:20 +03:00
talrid 240e667746 Revert "mixer_b16_224_miil" 2021-05-20 10:23:07 +03:00
李鑫杰 d046498e0b update test_models.py 2021-05-20 11:20:39 +08:00
李鑫杰 7b799c4e79 add latest code 2021-05-20 11:15:49 +08:00
Ross Wightman cf4ce2f15b
Merge pull request #647 from rwightman/more_mlp
Add preliminary gMLP and ResMLP impl to Mlp-Mixer
2021-05-19 12:47:12 -07:00
Ross Wightman b3b503c13d
Merge pull request #626 from cvcomar/master
fix: the exception not using default topk argument
2021-05-19 11:51:59 -07:00
Ross Wightman 6d81374b88 Update tests for new mlp models 2021-05-19 11:09:42 -07:00
talrid 5bcf686cb0 mixer_b16_224_miil 2021-05-19 20:51:10 +03:00
Ross Wightman d5af752117 Add preliminary gMLP and ResMLP impl to Mlp-Mixer 2021-05-19 09:55:05 -07:00
李鑫杰 00548b8427 Add Twins 2021-05-18 19:21:53 +08:00
Ross Wightman e7f0db8664 Fix drop/drop_path arg on MLP-Mixer model. Fix #641 2021-05-16 08:31:52 -07:00
Ross Wightman 9a3ae97311 Another set of byoanet models w/ ECA channel + SA + groups 2021-05-15 22:56:51 -07:00