8 Commits (a2e4a4c14849bc6012467b073a31d2a48036fd0e)

Author	SHA1	Message	Date
Yassine	884ef88818	fix all SDPA dropouts	2023-10-05 08:58:41 -07:00
Ross Wightman	3055411c1b	Fix samvit bug, add F.sdpa support and ROPE option (#1920) ... * Fix a bug I introduced in samvit, add F.sdpa support and ROPE option to samvit, neck is LayerNorm if not used and standard classifier used * Add attn dropout to F.sdpa * Fix fx trace for sam vit * Fixing torchscript issues in samvit * Another torchscript fix * samvit head fc name fix	2023-08-20 21:22:59 -07:00
Yonghye Kwon	2048f6f20f	set self.num_features to neck_chans if neck_chans > 0	2023-08-11 13:45:06 +09:00
SeeFun	c3f24a5ae5	‘add ViT weight from I-JEPA pretrain’	2023-06-14 22:30:31 +08:00
Ross Wightman	e9373b1b92	Cleanup before samvit merge. Resize abs posembed on the fly, undo some line-wraps, remove redundant unbind, fix HF hub weight load	2023-05-18 16:43:48 -07:00
方曦	c1c6eeb909	fix loading pretrained weight for samvit	2023-05-18 08:49:29 +08:00
方曦	15de561f2c	fix unit test for samvit	2023-05-17 12:51:12 +08:00
方曦	ea1f52df3e	add ViT for Segment-Anything Model	2023-05-17 11:39:29 +08:00