13 Commits

Author	SHA1	Message	Date
Dillon Laird	63ee54853c	fixed intermediate output indices	2023-11-22 16:32:41 -08:00
Yassine	884ef88818	fix all SDPA dropouts	2023-10-05 08:58:41 -07:00
Yassine	b500cae4c5	fastvit: don't dropout in eval	2023-10-05 08:58:41 -07:00
Yassine	5c504b4ded	flip these two	2023-09-27 10:24:12 -07:00
Yassine	8ba2038e6b	fast_vit: propagate act_layer argument	2023-09-27 10:24:12 -07:00
Ross Wightman	c8b2f28096	Fix a few typos, fix fastvit proj_drop, add code link	2023-08-28 21:26:29 -07:00
Ross Wightman	d6c348765a	Fix first_conv for mobileone and fastvit	2023-08-23 22:50:37 -07:00
Ross Wightman	16334e4bec	Fix two fastvit issues	2023-08-23 22:50:37 -07:00
Ross Wightman	5242ba6edc	MobileOne and FastViT weights on HF hub, more code cleanup and tweaks, features_only working. Add reparam flag to validate and benchmark, support reparm of all models with fuse(), reparameterize() or switch_to_deploy() methods on modules	2023-08-23 22:50:37 -07:00
Ross Wightman	40dbaafef5	Stagify FastViT /w downsample to top of stage	2023-08-23 22:50:37 -07:00
Ross Wightman	8470eb1cb5	More fastvit & mobileone updates, ready for weight upload	2023-08-23 22:50:37 -07:00
Ross Wightman	8474508d07	More work on FastViT, use own impl of MobileOne, validation working with remapped weight, more refactor TODO	2023-08-23 22:50:37 -07:00
Ross Wightman	c7a20cec13	Begin adding FastViT	2023-08-23 22:50:37 -07:00