Leng Yue 5cc87e6485

Add dinov2 pretrained models (#1797) ...

* add dinov2 small, base, and large

* fix input size

* fix swiglu & dinov2 vit giant

* use SwiGLUPacked to replace GluMlp

* clean up & add ffn_layer placeholder for ParallelScalingBlock

2023-05-09 12:24:47 -07:00

..

data

Merge pull request #212 from bryant1410/patch-1

2023-04-20 07:09:27 -07:00

layers

Add dinov2 pretrained models (#1797)

2023-05-09 12:24:47 -07:00

loss

Remove inplace operators when calculating the loss

2022-10-17 10:41:21 +02:00

models

Add dinov2 pretrained models (#1797)

2023-05-09 12:24:47 -07:00

optim

Add multi-tensor (foreach) version of Lion in style of upcoming PyTorch 2.0 optimizers

2023-02-16 15:48:00 -08:00

scheduler

Scheduler update, add v2 factory method, support scheduling on updates instead of just epochs. Add LR to summary csv. Add lr_base scaling calculations to train script. Fix #1168

2022-10-07 10:43:04 -07:00

utils

clip gradients with update

2023-04-19 23:36:20 -07:00

__init__.py

Major module / path restructure, timm.models.layers -> timm.layers, add _ prefix to all non model modules in timm.models

2022-12-06 15:00:06 -08:00

version.py

0.8.21dev0

2023-04-28 13:46:59 -07:00