Glenn Jocher 0f819919ad
Update EMA decay tau (#6769)
* Update EMA

* Update EMA

* ratio invert

* fix ratio invert

* fix2 ratio invert

* warmup iterations to 100

* ema_k

* implement tau

* implement tau
2022-02-25 12:33:09 +01:00
..
2022-02-12 16:05:43 +01:00
2022-02-20 21:47:46 +01:00
2022-02-05 15:22:59 +01:00
2022-02-25 00:09:14 +01:00
2022-02-25 12:33:09 +01:00