Ross Wightman
|
4f49b94311
|
Initial AGC impl. Still testing.
|
2021-02-15 23:22:44 -08:00 |
|
Ross Wightman
|
80078c47bb
|
Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support.
|
2020-10-09 17:24:43 -07:00 |
|
Ross Wightman
|
fcb6258877
|
Add missing leaky_relu layer factory defn, update Apex/Native loss scaler interfaces to support unscaled grad clipping. Bump ver to 0.2.2 for pending release.
|
2020-10-02 16:19:39 -07:00 |
|
Ross Wightman
|
532e3b417d
|
Reorg of utils into separate modules
|
2020-09-07 13:58:09 -07:00 |