Ross Wightman 803254bb40 Fix spacing misalignment for fast norm path in LayerNorm modules

2022-10-24 21:43:49 -07:00

..

__init__.py

MaxxVit! A very configurable MaxVit and CoAtNet impl with lots of goodies..

2022-08-22 17:42:10 -07:00

activations_jit.py

…

activations_me.py

Merge pull request #282 from tigert1998/patch-1

2021-02-04 12:18:40 -08:00

activations.py

…

adaptive_avgmax_pool.py

Refactoring, cleanup, improved test coverage.

2021-06-12 16:40:02 -07:00

attention_pool2d.py

Significant model refactor and additions:

2022-02-28 13:56:23 -08:00

blur_pool.py

Make a few more layers symbolically traceable (remove from FX leaf modules)

2022-03-24 21:43:56 -07:00

bottleneck_attn.py

wip - pre-rebase

2021-11-12 20:45:05 +00:00

cbam.py

Significant norm update

2021-12-14 13:48:30 -08:00

classifier.py

Significant model refactor and additions:

2022-02-28 13:56:23 -08:00

cond_conv2d.py

fixing channels_last on cond_conv2d; update nvfuser debug env variable

2022-04-25 12:41:46 -07:00

config.py

…

conv2d_same.py

…

conv_bn_act.py

Add more experimental darknet and 'cs2' darknet variants (different cross stage setup, closer to newer YOLO backbones) for train trials.

2022-07-01 15:14:01 -07:00

create_act.py

Add 'fast' layer norm that doesn't cast to float32, support APEX LN impl for slight speed gain, update norm and act factories, tweak SE for ability to disable bias (needed by GCVit)

2022-08-17 14:32:58 -07:00

create_attn.py

Add MobileVitV2 support. Fix #1332. Move GroupNorm1 to common layers (used in poolformer + mobilevitv2). Keep ol custom ConvNeXt LayerNorm2d impl as LayerNormExp2d for reference.

2022-07-07 14:41:01 -07:00

create_conv2d.py

Significant norm update

2021-12-14 13:48:30 -08:00

create_norm_act.py

More model and test fixes

2022-08-22 17:40:31 -07:00

create_norm.py

Add 'fast' layer norm that doesn't cast to float32, support APEX LN impl for slight speed gain, update norm and act factories, tweak SE for ability to disable bias (needed by GCVit)

2022-08-17 14:32:58 -07:00

drop.py

Improve repr for DropPath module

2022-06-24 14:58:15 -07:00

eca.py

Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.

2021-05-31 13:18:11 -07:00

evo_norm.py

Remove SiLU layer in default args that breaks import on old old PyTorch

2022-06-24 14:56:58 -07:00

fast_norm.py

Add norm/norm_act header comments

2022-08-25 16:29:34 -07:00

filter_response_norm.py

Updated EvoNorm implementations with some experimentation. Add FilterResponseNorm. Updated RegnetZ and ResNetV2 model defs for trials.

2021-12-01 12:09:01 -08:00

gather_excite.py

Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.

2021-05-27 18:03:29 -07:00

global_context.py

wip - pre-rebase

2021-11-12 20:45:05 +00:00

halo_attn.py

wip - pre-rebase

2021-11-12 20:45:05 +00:00

helpers.py

MaxxVit! A very configurable MaxVit and CoAtNet impl with lots of goodies..

2022-08-22 17:42:10 -07:00

inplace_abn.py

Significant norm update

2021-12-14 13:48:30 -08:00

lambda_layer.py

wip - pre-rebase

2021-11-12 20:45:05 +00:00

linear.py

…

median_pool.py

…

mixed_conv2d.py

Use in_channels for depthwise groups, allows using out_channels=N * in_channels (does not impact existing models). Fix #354.

2021-02-09 16:22:52 -08:00

ml_decoder.py

support CNNs

2021-11-30 08:48:08 +02:00

mlp.py

Add updated vit_relpos weights, and impl w/ support for official swin-v2 differences for relpos. Add bias control support for MLP layers

2022-05-13 13:53:57 -07:00

non_local_attn.py

Significant norm update

2021-12-14 13:48:30 -08:00

norm_act.py

Add norm/norm_act header comments

2022-08-25 16:29:34 -07:00

norm.py

Fix spacing misalignment for fast norm path in LayerNorm modules

2022-10-24 21:43:49 -07:00

padding.py

…

patch_embed.py

Adding support for fine-tune CLIP LAION-2B image tower weights for B/32, L/14, H/14 and g/14. Still WIP

2022-09-15 17:25:59 -07:00

pool2d_same.py

Support npz custom load for vision transformer hybrid models. Add posembed rescale for npz load.

2021-06-14 12:31:44 -07:00

pos_embed.py

Significant model refactor and additions:

2022-02-28 13:56:23 -08:00

selective_kernel.py

Significant norm update

2021-12-14 13:48:30 -08:00

separable_conv.py

Significant norm update

2021-12-14 13:48:30 -08:00

space_to_depth.py

…

split_attn.py

Significant norm update

2021-12-14 13:48:30 -08:00

split_batchnorm.py

…

squeeze_excite.py

Add CL SE module

2022-09-23 16:06:09 -07:00

std_conv.py

Use reshape instead of view in std_conv, causing issues in recent PyTorch in channels_last

2021-09-23 15:43:48 -07:00

test_time_pool.py

Add --use-train-size flag to force use of train input_size (over test input size) for validation. Default test-time pooling to use train input size (fixes issues).

2022-07-07 22:01:24 -07:00

trace_utils.py

Better fix for #954 that doesn't break torchscript, pull torch._assert into timm namespace when it exists

2021-11-02 11:22:33 -07:00

weight_init.py

Clean up no_grad for trunc normal weight inits

2022-08-25 16:29:52 -07:00