Ross Wightman
|
0b65b5c0ac
|
Add finalized eva CLIP weights pointing to remapped timm hub models
|
2023-04-10 23:13:12 -07:00 |
|
Ross Wightman
|
965d0a2d36
|
fast_attn -> fused_attn, implement global config for enable/disable fused_attn, add to more models. vit clip openai 336 weights.
|
2023-04-10 12:04:33 -07:00 |
|
Ross Wightman
|
4d135421a3
|
Implement patch dropout for eva / vision_transformer, refactor / improve consistency of dropout args across all vit based models
|
2023-04-07 20:27:23 -07:00 |
|
Ross Wightman
|
1bb3989b61
|
Improve kwarg passthrough for swin, vit, deit, beit, eva
|
2023-04-05 21:37:16 -07:00 |
|
Ross Wightman
|
adeb9de7c6
|
Mismatch in eva pretrained_cfg vs model for one of the clip variants
|
2023-03-31 10:30:30 -07:00 |
|
Ross Wightman
|
0737bd3ec8
|
eva02 non-CLIP weights on HF hub, add initial eva02 clip model configs w/ postnorm variant & attn LN
|
2023-03-30 23:43:59 -07:00 |
|
Ross Wightman
|
ac67098147
|
Add final attr for fast_attn on beit / eva
|
2023-03-28 08:40:40 -07:00 |
|
Ross Wightman
|
3863d63516
|
Adding EVA02 weights and model defs, move beit based eva_giant to same eva.py file. Cleanup rotary pos, add lang oriented freq bands to be compat with eva design choice. Fix #1738
|
2023-03-27 17:16:07 -07:00 |