Commit Graph

3 Commits (61bf9e1af1275a4f5625ce99d34b813f1901ccc6)

Author SHA1 Message Date
Ross Wightman afdf11d9ae Add caution to Adan. Add decouple decay option to LAMB. 2024-12-05 13:50:30 -08:00
Ross Wightman 1ab02a11a1 Update Adan with newer impl (from original source) that includes multi-tensor fn 2024-11-26 15:10:15 -08:00
Ross Wightman 2a296412be Add Adan optimizer 2022-09-23 16:05:52 -07:00