Ross Wightman 803254bb40 Fix spacing misalignment for fast norm path in LayerNorm modules

2022-10-24 21:43:49 -07:00

..

__init__.py

MaxxVit! A very configurable MaxVit and CoAtNet impl with lots of goodies..

2022-08-22 17:42:10 -07:00

activations_jit.py

…

activations_me.py

…

activations.py

…

adaptive_avgmax_pool.py

…

attention_pool2d.py

…

blur_pool.py

…

bottleneck_attn.py

…

cbam.py

…

classifier.py

…

cond_conv2d.py

…

config.py

…

conv2d_same.py

…

conv_bn_act.py

…

create_act.py

Add 'fast' layer norm that doesn't cast to float32, support APEX LN impl for slight speed gain, update norm and act factories, tweak SE for ability to disable bias (needed by GCVit)

2022-08-17 14:32:58 -07:00

create_attn.py

Add MobileVitV2 support. Fix #1332. Move GroupNorm1 to common layers (used in poolformer + mobilevitv2). Keep ol custom ConvNeXt LayerNorm2d impl as LayerNormExp2d for reference.

2022-07-07 14:41:01 -07:00

create_conv2d.py

…

create_norm_act.py

More model and test fixes

2022-08-22 17:40:31 -07:00

create_norm.py

Add 'fast' layer norm that doesn't cast to float32, support APEX LN impl for slight speed gain, update norm and act factories, tweak SE for ability to disable bias (needed by GCVit)

2022-08-17 14:32:58 -07:00

drop.py

…

eca.py

…

evo_norm.py

…

fast_norm.py

Add norm/norm_act header comments

2022-08-25 16:29:34 -07:00

filter_response_norm.py

…

gather_excite.py

…

global_context.py

…

halo_attn.py

…

helpers.py

MaxxVit! A very configurable MaxVit and CoAtNet impl with lots of goodies..

2022-08-22 17:42:10 -07:00

inplace_abn.py

…

lambda_layer.py

…

linear.py

…

median_pool.py

…

mixed_conv2d.py

…

ml_decoder.py

…

mlp.py

…

non_local_attn.py

…

norm_act.py

Add norm/norm_act header comments

2022-08-25 16:29:34 -07:00

norm.py

Fix spacing misalignment for fast norm path in LayerNorm modules

2022-10-24 21:43:49 -07:00

padding.py

…

patch_embed.py

Adding support for fine-tune CLIP LAION-2B image tower weights for B/32, L/14, H/14 and g/14. Still WIP

2022-09-15 17:25:59 -07:00

pool2d_same.py

…

pos_embed.py

…

selective_kernel.py

…

separable_conv.py

…

space_to_depth.py

…

split_attn.py

…

split_batchnorm.py

…

squeeze_excite.py

Add CL SE module

2022-09-23 16:06:09 -07:00

std_conv.py

…

test_time_pool.py

Add --use-train-size flag to force use of train input_size (over test input size) for validation. Default test-time pooling to use train input size (fixes issues).

2022-07-07 22:01:24 -07:00

trace_utils.py

…

weight_init.py

Clean up no_grad for trunc normal weight inits

2022-08-25 16:29:52 -07:00