Ross Wightman 621e1b2182 Add ideas from 'Scaling ViT to 22-B Params', testing PyTorch 2.0 fused F.scaled_dot_product_attention impl in vit, vit_relpos, maxxvit / coatnet.

2023-02-16 16:57:42 -08:00

..

data

Improve support for custom dataset label name/description through HF hub export, via pretrained_cfg

2023-02-08 08:29:20 -08:00

layers

Add ideas from 'Scaling ViT to 22-B Params', testing PyTorch 2.0 fused F.scaled_dot_product_attention impl in vit, vit_relpos, maxxvit / coatnet.

2023-02-16 16:57:42 -08:00

loss

Remove inplace operators when calculating the loss

2022-10-17 10:41:21 +02:00

models

Add ideas from 'Scaling ViT to 22-B Params', testing PyTorch 2.0 fused F.scaled_dot_product_attention impl in vit, vit_relpos, maxxvit / coatnet.

2023-02-16 16:57:42 -08:00

optim

Add multi-tensor (foreach) version of Lion in style of upcoming PyTorch 2.0 optimizers

2023-02-16 15:48:00 -08:00

scheduler

Scheduler update, add v2 factory method, support scheduling on updates instead of just epochs. Add LR to summary csv. Add lr_base scaling calculations to train script. Fix #1168

2022-10-07 10:43:04 -07:00

utils

Davit update formatting and fix grad checkpointing (#7)

2023-01-15 14:34:56 -08:00

__init__.py

Major module / path restructure, timm.models.layers -> timm.layers, add _ prefix to all non model modules in timm.models

2022-12-06 15:00:06 -08:00

version.py

Version 0.8.12dev0

2023-02-16 16:27:29 -08:00