Ross Wightman
5f10450235
Some more kron work. Figured out why some tests fail, implemented a deterministic rng state load but too slow so skipping some tests for now.
2025-01-27 21:02:26 -08:00
Ryan
bda46f8e6f
Add num_classes assertion after reset_classifier
2025-01-21 11:52:05 -08:00
Louis Lac
2d5277e858
Merge branch 'main' into fix-mqa-v2
2025-01-02 00:11:22 +01:00
Louis Lac
2d734d9058
Fixed unfused attn2d scale
2025-01-01 12:34:07 -08:00
Louis Lac
6171e756d3
Fix MQA V2 scale and out shape
2025-01-01 15:37:28 +01:00
Ross Wightman
cc7fd34015
test filter tweaks
2024-12-30 19:24:21 -08:00
Ross Wightman
1bf84b35c3
Update tests for aimv2 filtering
2024-12-30 19:24:21 -08:00
Ross Wightman
303f7691a1
Add cautious mars, improve test reliability by skipping grad diff for first step
2024-12-02 11:29:02 -08:00
Ross Wightman
7cf683628f
Cautious optimizer impl plus some typing cleanup.
2024-11-28 15:11:58 -08:00
Ross Wightman
aeb1ed7a15
Keep basic optim test LR range closer to before w/ updated code
2024-11-26 15:10:15 -08:00
Ross Wightman
7a165fcb62
Remove rogue import, thanks IDE :/
2024-11-26 15:10:15 -08:00
Ross Wightman
73d10ab482
Update tests, need handling for radamw with older PyTorch, need to back-off basic test LR in mars?
2024-11-26 15:10:15 -08:00
Ross Wightman
0903d98162
Reduce tolerance on model inference 'owl' test, pillow output varies a lot, was failing locally
2024-11-26 15:10:15 -08:00
Ross Wightman
a024ab3170
Replace radam & nadam impl with torch.optim ver, rename legacy adamw, nadam, radam impl in timm. Update optim factory & tests.
2024-11-26 15:10:15 -08:00
Ross Wightman
0b5264a108
Missing optimizers in __init__.py, add bind_defaults=False for unit tests
2024-11-13 10:50:46 -08:00
Ross Wightman
dde990785e
More fixes for new factory & tests, add back adahessian
2024-11-12 20:49:01 -08:00
Ross Wightman
45490ac52f
Post merge fix reference of old param groups helper fn locations
2024-11-12 20:49:01 -08:00
Ross Wightman
ee5f6e76bb
A bit of an optimizer overhaul, added an improved factory, list_optimizers, class helper and add info classes with descriptions, arg configs
2024-11-12 20:49:01 -08:00
Ross Wightman
94e0560aba
Remove an indent level in init_group for adopt, update optim tests, adopt failing rosenbrock
2024-11-12 20:49:01 -08:00
mrT23
e31e5d2d64
imports
2024-11-12 07:53:39 -08:00
Tal
68d5a64e45
extend existing unittests
2024-11-12 07:53:39 -08:00
Ross Wightman
95907e69c2
Further reduce atol for model comparison, move python 3.11 + torch 2.2 -> python 3.12 + torch 2.4.1
2024-10-02 10:05:27 -07:00
Ross Wightman
fde6719403
relax tolerance on inference test
2024-10-02 09:53:17 -07:00
Ross Wightman
0e27f302a0
Do full inference test against test vectors for test_* models
2024-10-02 09:39:26 -07:00
Ross Wightman
0b05122cda
Fixing hieradet (sam2) tests
2024-08-16 14:33:40 -07:00
Ross Wightman
f920119f3b
Fixing tests
2024-07-09 14:53:20 -07:00
Daniel Suess
197c10463b
Fix jit.script breaking with features_fx
2024-06-28 03:58:51 +00:00
Ross Wightman
a5a2ad2e48
Fix consistency, testing for forward_head w/ pre_logits, reset_classifier, models with pre_logits size != unpooled feature size
...
* add test that model supports forward_head(x, pre_logits=True)
* add head_hidden_size attr to all models and set differently from num_features attr when head has hidden layers
* test forward_features() feat dim == model.num_features and pre_logits feat dim == self.head_hidden_size
* more consistency in reset_classifier signature, add typing
* asserts in some heads where pooling cannot be disabled
Fix #2194
2024-06-07 13:53:00 -07:00
Ross Wightman
5756a81c55
Merge remote-tracking branch 'origin/Beckschen-vitamin' into fastvit_mobileclip
2024-06-05 15:20:54 -07:00
Ross Wightman
0e77c95ed7
Add vitamin to non-std testing models
2024-06-05 00:20:00 -07:00
Ross Wightman
ce637771dc
Add fastvit to forward_intermediates test
2024-05-30 10:18:24 -07:00
Ross Wightman
2ca45a4ff5
Merge remote-tracking branch 'upstream/main' into hiera
2024-05-11 15:43:05 -07:00
Ross Wightman
45b7ae8029
forward_intermediates() support for byob/byoanet models
2024-05-04 14:06:52 -07:00
Ross Wightman
c719f7eb86
More forward_intermediates() updates
...
* add convnext, resnet, efficientformer, levit support
* remove kwargs only for fn so that torchscript isn't broken for all :(
* use reset_classifier() consistently in prune
2024-05-03 16:22:32 -07:00
Ross Wightman
d6da4fb01e
Add forward_intermediates() to efficientnet / mobilenetv3 based models as an exercise.
2024-05-02 14:19:16 -07:00
Ross Wightman
67332fce24
Add features_intermediate() support to coatnet, maxvit, swin* models. Refine feature interface. Start prep of new vit weights.
2024-04-30 16:56:33 -07:00
Ross Wightman
63970e4e61
Update tests for volo/cait/xcit forward_intermediates
2024-04-29 17:19:11 -07:00
Ross Wightman
e8b08a4e7b
Disable jit test for Hiera, fair bit of work to fix.
2024-04-22 10:39:30 -07:00
Ross Wightman
ef147fd2fb
Add forward_intermediates API to Hiera for features_only=True support
2024-04-21 11:30:41 -07:00
Ross Wightman
fe3cf542fa
Fix / improve tests for features
2024-04-10 21:14:02 -07:00
Ross Wightman
4b2565e4cb
More forward_intermediates() / FeatureGetterNet work
...
* include relpos vit
* refactor reduction / size calcs so hybrid vits work and dynamic_img_size works
* fix -ve feature indices when pruning
* fix mvitv2 w/ class token
* refine naming
* add tests
2024-04-10 15:11:34 -07:00
Alex Cunha
a38c2b4475
fix bug
2023-11-16 20:27:59 -08:00
Alex Cunha
bbf0ab000c
return if cuda not available
2023-11-16 20:27:59 -08:00
Alex Cunha
e628ed7e67
device agnostic testing
2023-11-16 20:27:59 -08:00
Ross Wightman
68b2824e49
Update optim test to remove Variable/.data and fix _state_dict optim test for PyTorch 2.1 ( #1988 )
...
* Update optim test to remove Variable/.data and fix _state_dict optim test
* Attempt to run python 3.11 w/ 2.1
* Try factoring out testmarker to common var
* More fiddling
* Abandon attempt to reduce redunancy
* Another try
2023-10-12 11:53:10 -07:00
方曦
0198a2019e
tinyvit skip ci test
2023-09-01 11:05:56 -07:00
Ross Wightman
7c2728c6fe
Merge pull request #1919 from ChengpengChen/main
...
Add RepGhost models and weights
2023-08-19 16:26:45 -07:00
方曦
00f670fa69
fix bug in ci for efficientvits
2023-08-17 14:40:17 +08:00
Chengpeng Chen
d1d0193615
Add RepGhost models and weights
2023-08-16 11:54:53 +08:00
方曦
15de561f2c
fix unit test for samvit
2023-05-17 12:51:12 +08:00