Ross Wightman a4146b79d1 Add SimpleNorm to create_norm factory

2024-12-30 14:22:42 -08:00

..

__init__.py

Fixing RmsNorm to fix #2380 and noticed with aimv2 when comparing outputs. Still some work to do, need to look at AMP / fast mode behaviour, dispatch to torch when possible. Add SimpleNorm for 'LayerNorm w/o centering and bias'

2024-12-28 21:03:49 -08:00

activations_me.py

Remove JIT activations, take jit out of ME activations. Remove other instances of torch.jit.script. Breaks torch.compile and is much less performant. Remove SpaceToDepthModule

2024-05-06 16:32:49 -07:00

activations.py

…

adaptive_avgmax_pool.py

…

attention2d.py

Add xavier_uniform init of MNVC hybrid attention modules. Small improvement in training stability.

2024-07-26 17:03:40 -07:00

attention_pool2d.py

…

attention_pool.py

…

blur_pool.py

…

bottleneck_attn.py

Major module / path restructure, timm.models.layers -> timm.layers, add _ prefix to all non model modules in timm.models

2022-12-06 15:00:06 -08:00

cbam.py

…

classifier.py

More Hiera updates. Add forward_intermediates to hieradat/sam2 impl. Make both use same classifier module. Add coarse bool to intermediates.

2024-08-16 11:10:04 -07:00

cond_conv2d.py

…

config.py

fast_attn -> fused_attn, implement global config for enable/disable fused_attn, add to more models. vit clip openai 336 weights.

2023-04-10 12:04:33 -07:00

conv2d_same.py

…

conv_bn_act.py

See if we can avoid some model / layer pickle issues with the aa attr in ConvNormAct

2024-12-03 08:02:55 -08:00

create_act.py

Add WIP HieraDet impl (SAM2 backbone support)

2024-08-15 17:58:15 -07:00

create_attn.py

…

create_conv2d.py

…

create_norm_act.py

Consistency handling None / empty string inputs to norm / act create fns

2023-11-03 11:01:41 -07:00

create_norm.py

Add SimpleNorm to create_norm factory

2024-12-30 14:22:42 -08:00

drop.py

…

eca.py

…

evo_norm.py

…

fast_norm.py

Use torch F.rms_norm when possible, select fast vs normal paths appropriately and test with torchscript

2024-12-29 14:05:07 -08:00

filter_response_norm.py

…

format.py

…

gather_excite.py

Major module / path restructure, timm.models.layers -> timm.layers, add _ prefix to all non model modules in timm.models

2022-12-06 15:00:06 -08:00

global_context.py

…

grid.py

…

grn.py

…

halo_attn.py

…

helpers.py

Fixed Typos

2023-10-21 21:46:31 -07:00

hybrid_embed.py

…

inplace_abn.py

…

interpolate.py

…

lambda_layer.py

…

layer_scale.py

Fix hiera init with num_classes=0, fix weight tag names for sbb2 hiera/vit weights, add LayerScale/LayerScale2d to layers

2024-08-15 11:14:38 -07:00

linear.py

…

median_pool.py

…

mixed_conv2d.py

…

ml_decoder.py

Remove JIT activations, take jit out of ME activations. Remove other instances of torch.jit.script. Breaks torch.compile and is much less performant. Remove SpaceToDepthModule

2024-05-06 16:32:49 -07:00

mlp.py

Switch aimv2 to used packed SwiGLU

2024-12-28 21:05:38 -08:00

non_local_attn.py

…

norm_act.py

Add ConvStem and MobileCLIP hybrid model for B variant. Add full norm disable support to ConvNormAct layers

2024-06-06 09:15:27 -07:00

norm.py

Use torch F.rms_norm when possible, select fast vs normal paths appropriately and test with torchscript

2024-12-29 14:05:07 -08:00

padding.py

…

patch_dropout.py

Credit earlier work with the same idea.

2024-05-16 22:50:34 +02:00

patch_embed.py

…

pool2d_same.py

…

pos_embed_rel.py

…

pos_embed_sincos.py

…

pos_embed.py

…

selective_kernel.py

Remove separate ConvNormActAa class, merge with ConvNormAct

2024-06-10 12:05:35 -07:00

separable_conv.py

…

space_to_depth.py

…

split_attn.py

Major module / path restructure, timm.models.layers -> timm.layers, add _ prefix to all non model modules in timm.models

2022-12-06 15:00:06 -08:00

split_batchnorm.py

…

squeeze_excite.py

…

std_conv.py

…

test_time_pool.py

…

trace_utils.py

…

typing.py

…

weight_init.py

Rename global pos embed for Hiera abswin, factor out commonly used vit weight init fns to layers. Add a channels-last ver of normmlp head.

2024-08-15 17:46:36 -07:00