5 Commits

Author SHA1 Message Date
Ross Wightman
379780bb6c Remove sdpa context mgrs 2023-09-25 23:30:56 -07:00
Ross Wightman
2734bb76ce Remove key_padding masking, sequence isolation is enough. 2023-09-23 15:45:11 -07:00
Ross Wightman
f93083e2b2 Remove padding calc from pack, minor fixes 2023-09-14 10:12:07 -07:00
Ross Wightman
d81f75b461 Remove patch dropout layer as it should be integrated into packing 2023-09-13 15:47:51 -07:00
Ross Wightman
64614050cc Initial impl of WIP packed vit (navit) 2023-09-13 15:46:12 -07:00