mirrors/pytorch-image-models
1
0
Fork 0
mirror of https://github.com/huggingface/pytorch-image-models.git synced 2025-06-03 15:01:08 +08:00
Code Issues Projects Releases Wiki Activity
2,527 Commits 141 Branches 65 Tags
Commit Graph

5 Commits

Author SHA1 Message Date
Ross Wightman
7ea5016fc4 Change adafactor_bv epsilon default 2024-11-05 13:03:13 -08:00
Ross Wightman
548fdb5d71 Remove adafactorbv numpy dep, hack fix for loading optimizer state w/ half prec momentum (need better one) 2024-11-04 14:54:41 -08:00
Ross Wightman
91f0ea3338 Need to init momentum with correct dtype 2024-11-04 09:36:00 -08:00
Ross Wightman
30142b6fcf Remove unused beta2 fn, make eps grad^2 handling same across factorized and non-factorized cases 2024-11-04 09:23:04 -08:00
Ross Wightman
a4d93cf6f8 An impl of adafactor as per big vision (scaling vit) changes 2024-11-03 17:08:58 -08:00