Ross Wightman 925e102982 Update attention / self-attn based models from a series of experiments: ...

* remove dud attention, involution + my swin attention adaptation don't seem worth keeping
* add or update several new 26/50 layer ResNe(X)t variants that were used in experiments
* remove models associated with dead-end or uninteresting experiment results
* weights coming soon...

2021-08-20 16:13:11 -07:00

..

layers

Update attention / self-attn based models from a series of experiments:

2021-08-20 16:13:11 -07:00

pruned

added efficientnet pruned weights

2020-05-03 09:29:45 +03:00

__init__.py

wip xcit

2021-07-11 09:39:38 +01:00

byoanet.py

Update attention / self-attn based models from a series of experiments:

2021-08-20 16:13:11 -07:00

byobnet.py

Update attention / self-attn based models from a series of experiments:

2021-08-20 16:13:11 -07:00

cait.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

coat.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

convit.py

Merge branch 'master' into cleanup_xla_model_fixes

2021-06-12 23:19:25 -07:00

cspnet.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

densenet.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

dla.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

dpn.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

efficientnet_blocks.py

Bring EfficientNet SE layer in line with others, pull se_ratio outside of blocks. Allows swapping w/ other attn layers.

2021-05-29 23:41:38 -07:00

efficientnet_builder.py

Able to use other attn layer in EfficientNet now. Create test ECA + GC B0 configs. Make ECA more configurable.

2021-05-30 12:47:02 -07:00

efficientnet.py

Add gc_efficientnetv2_rw_t weights (global context instead of SE attn). Add TF XL weights even though the fine-tuned ones don't validate that well. Change default arg for GlobalContext to use scal (mul) mode.

2021-08-07 16:45:29 -07:00

factory.py

A few minor fixes and bit more cleanup on the huggingface hub integration.

2021-03-17 13:18:52 -07:00

features.py

Fix some attributions, add copyrights to some file docstrings

2020-07-27 13:44:56 -07:00

ghostnet.py

Fix a few issues loading pretrained vit/bit npz weights w/ num_classes=0 __init__ arg. Missed a few other small classifier handling detail on Mlp, GhostNet, Levit. Should fix #713

2021-06-22 23:16:05 -07:00

gluon_resnet.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

gluon_xception.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

hardcorenas.py

Bring EfficientNet SE layer in line with others, pull se_ratio outside of blocks. Allows swapping w/ other attn layers.

2021-05-29 23:41:38 -07:00

helpers.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

hrnet.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

hub.py

Change huggingface hub revision delimiter to '@', add hf_hub reference for eca_nfnet_l0 model as an example.

2021-03-18 11:38:06 -07:00

inception_resnet_v2.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

inception_v3.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

inception_v4.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

levit.py

Fix a few issues loading pretrained vit/bit npz weights w/ num_classes=0 __init__ arg. Missed a few other small classifier handling detail on Mlp, GhostNet, Levit. Should fix #713

2021-06-22 23:16:05 -07:00

mlp_mixer.py

Add gMLP-S weights, 79.6 top-1

2021-06-23 10:40:30 -07:00

mobilenetv3.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

nasnet.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

nest.py

Use bicubic interpolation in resize_pos_embed()

2021-07-12 10:38:31 -07:00

nfnet.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

pit.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

pnasnet.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

registry.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

regnet.py

Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.

2021-05-27 18:03:29 -07:00

res2net.py

Fix incorrect name of shortcut/identity paths in many residual nets. Inherited from naming in old old torchvision, long fixed there.

2021-05-04 21:27:15 -07:00

resnest.py

Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.

2021-05-31 13:18:11 -07:00

resnet.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

resnetv2.py

Fix features for resnetv2_50t

2021-06-28 15:56:24 -07:00

rexnet.py

Post merge cleanup

2021-06-07 14:38:30 -07:00

selecsls.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

senet.py

Fix incorrect name of shortcut/identity paths in many residual nets. Inherited from naming in old old torchvision, long fixed there.

2021-05-04 21:27:15 -07:00

sknet.py

Remove min channels for SelectiveKernel, divisor should cover cases well enough.

2021-05-31 15:38:56 -07:00

swin_transformer.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

tnt.py

Expand scope of testing for non-std vision transformer / mlp models. Some related cleanup and create fn cleanup for all vision transformer and mlp models. More CoaT weights.

2021-05-24 21:13:26 -07:00

tresnet.py

Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.

2021-05-27 18:03:29 -07:00

twins.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

vgg.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

visformer.py

Fix a few issues loading pretrained vit/bit npz weights w/ num_classes=0 __init__ arg. Missed a few other small classifier handling detail on Mlp, GhostNet, Levit. Should fix #713

2021-06-22 23:16:05 -07:00

vision_transformer_hybrid.py

AugReg release

2021-06-20 17:46:06 -07:00

vision_transformer.py

Use bicubic interpolation in resize_pos_embed()

2021-07-12 10:38:31 -07:00

vovnet.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

xception_aligned.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

xception.py

Support for huggingface hub via create_model and default_cfgs.

2021-03-16 22:48:26 -07:00

xcit.py

Allow act_layer switch for xcit, fix in_chans for some variants

2021-07-12 13:27:29 -07:00