Ross Wightman
|
27bbc70d71
|
Add back old ModelEma and rename new one to ModelEmaV2 to avoid compat breaks in dependant code. Shuffle train script, add a few comments, remove DataParallel support, support experimental torchscript training.
|
2020-11-29 16:22:19 -08:00 |
|
Ross Wightman
|
9214ca0716
|
Simplifying EMA...
|
2020-11-16 12:51:52 -08:00 |
|
Ross Wightman
|
4a3df7842a
|
Fix topn metric view regression on PyTorch 1.7
|
2020-10-29 14:04:15 -07:00 |
|
Ross Wightman
|
80078c47bb
|
Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support.
|
2020-10-09 17:24:43 -07:00 |
|
Ross Wightman
|
fcb6258877
|
Add missing leaky_relu layer factory defn, update Apex/Native loss scaler interfaces to support unscaled grad clipping. Bump ver to 0.2.2 for pending release.
|
2020-10-02 16:19:39 -07:00 |
|
Ross Wightman
|
532e3b417d
|
Reorg of utils into separate modules
|
2020-09-07 13:58:09 -07:00 |