Ross Wightman
a5a2ad2e48
Fix consistency, testing for forward_head w/ pre_logits, reset_classifier, models with pre_logits size != unpooled feature size
...
* add test that model supports forward_head(x, pre_logits=True)
* add head_hidden_size attr to all models and set differently from num_features attr when head has hidden layers
* test forward_features() feat dim == model.num_features and pre_logits feat dim == self.head_hidden_size
* more consistency in reset_classifier signature, add typing
* asserts in some heads where pooling cannot be disabled
Fix #2194
2024-06-07 13:53:00 -07:00
Ross Wightman
c838c4233f
Add typing to reset_classifier() on other models
2024-05-12 11:12:00 -07:00
Ross Wightman
c6b0c98963
Upload weights to hub, tweak crop_pct, comment out SAM EfficientViTs for now (v2 weights comming)
2023-11-21 14:05:04 -08:00
方曦
c9d093a58e
update norm eps for efficientvit large
2023-11-18 17:46:47 +08:00
方曦
87ba43a9bc
add efficientvit large series
2023-11-17 13:58:46 +08:00
Ross Wightman
0d124ffd4f
Update README. Fine-grained layer-wise lr decay working for tiny_vit and both efficientvits. Minor fixes.
2023-09-01 15:05:29 -07:00
Ross Wightman
983310d6a2
Fix #1935 , torch.amp.autocast -> torch.autocast (namespace issue for 1.10 pt compat)
2023-08-30 15:03:28 -07:00
Ross Wightman
300f54a96f
Another effcientvit (mit) tweak, fix torchscript/fx conflict with autocast disable
2023-08-20 15:07:25 -07:00
Ross Wightman
dc18cda2e7
efficientvit (mit) msa attention q/k/v ops need to be in float32 to train w/o NaN
2023-08-20 11:49:36 -07:00
Ross Wightman
7d7589e8da
Fixing efficient_vit torchscript, fx, default_cfg issues
2023-08-18 23:23:11 -07:00
Ross Wightman
c28324a150
Update efficient_vit (msra), hf hub weights
2023-08-18 16:45:37 -07:00
Ross Wightman
e700a32626
Cleanup of efficient_vit (mit), tweak eps for better AMP behaviour, formatting/cleanup, weights on hf hub
2023-08-18 16:06:07 -07:00
方曦
00f670fa69
fix bug in ci for efficientvits
2023-08-17 14:40:17 +08:00
方曦
047bab6ab2
efficientvit_mit stage refactor
2023-08-03 14:59:35 +08:00
方曦
43443f64eb
fix efficientvits
2023-08-02 14:12:37 +08:00
方曦
82d1e99e1a
add efficientvit(msra)
2023-08-01 18:51:08 +08:00
方曦
b91a77fab7
add EfficientVit (MIT)
2023-08-01 12:42:21 +08:00