Commit Graph

14 Commits (5d535d7a2d4b435b1b5c1177fd8f04a12b942b9a)

Author SHA1 Message Date
Ross Wightman a5a2ad2e48 Fix consistency, testing for forward_head w/ pre_logits, reset_classifier, models with pre_logits size != unpooled feature size
* add test that model supports forward_head(x, pre_logits=True)
* add head_hidden_size attr to all models and set differently from num_features attr when head has hidden layers
* test forward_features() feat dim == model.num_features and pre_logits feat dim == self.head_hidden_size
* more consistency in reset_classifier signature, add typing
* asserts in some heads where pooling cannot be disabled
Fix #2194
2024-06-07 13:53:00 -07:00
Ross Wightman c838c4233f Add typing to reset_classifier() on other models 2024-05-12 11:12:00 -07:00
Ross Wightman d6c2cc91af Make NormMlpClassifier head reset args consistent with ClassifierHead 2024-02-10 16:25:33 -08:00
Nguyen Nhat Hoang 95ba90157f Update tiny_vit.py to fix bug 2023-09-23 10:05:52 -07:00
Ross Wightman 0d124ffd4f Update README. Fine-grained layer-wise lr decay working for tiny_vit and both efficientvits. Minor fixes. 2023-09-01 15:05:29 -07:00
Ross Wightman 2f0fbb59b3 TinyViT weights on HF hub 2023-09-01 11:05:56 -07:00
Ross Wightman 507cb08acf TinyVitBlock needs adding as leaf for FX now, tweak a few dim names 2023-09-01 11:05:56 -07:00
Ross Wightman 9caf32b93f Move levit style pos bias resize with other rel pos bias utils 2023-09-01 11:05:56 -07:00
Ross Wightman 63417b438f TinyViT adjustments
* keep most of net in BCHW layout, performance appears same, can remove static resolution attribs and features easier to use
* add F.sdpa, decent gains in pt 2.1
* tweak crop pct based on eval
2023-09-01 11:05:56 -07:00
方曦 39aa44b192 Fixing tinyvit trace issue 2023-09-01 11:05:56 -07:00
方曦 aea3b9c854 Fixing tinyvit input_size issue 2023-09-01 11:05:56 -07:00
方曦 fabc4e5bcd Fixing tinyvit torchscript issue 2023-09-01 11:05:56 -07:00
方曦 bae949f830 fix attention_bias_cache in tinyvit 2023-09-01 11:05:56 -07:00
方曦 170a5b6e27 add tinyvit 2023-09-01 11:05:56 -07:00