Ross Wightman
|
9d8ccd2ba7
|
A bit of lars/lamb cleanup, torch.where supports scalars properly now, make lamb grad clipping optional, clean it up a bit
|
2024-11-12 20:49:01 -08:00 |
Mi-Peng
|
cdcd0a92ca
|
fix lars
|
2022-01-19 17:49:43 +08:00 |
|
Ross Wightman
|
a16a753852
|
Add lamb/lars to optim init imports, remove stray comment
|
2021-08-18 22:55:02 -07:00 |
|
Ross Wightman
|
c207e02782
|
MOAR optimizer changes. Woo!
|
2021-08-18 22:20:35 -07:00 |
|
Ross Wightman
|
a426511c95
|
More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.
|
2021-08-18 17:21:56 -07:00 |