Glenn Jocher
0f819919ad
Update EMA decay tau
(#6769)
* Update EMA
* Update EMA
* ratio invert
* fix ratio invert
* fix2 ratio invert
* warmup iterations to 100
* ema_k
* implement tau
* implement tau
2022-02-25 12:33:09 +01:00
..
2021-11-15 20:10:29 +01:00
2022-02-14 17:08:36 +01:00
2021-12-08 17:31:31 +01:00
2021-12-02 16:06:45 +01:00
2021-12-15 14:42:23 +01:00
2022-02-17 12:55:03 +01:00
2021-11-13 15:40:18 +01:00
2022-02-12 16:05:43 +01:00
2022-01-22 16:37:21 -10:00
2022-02-20 21:47:46 +01:00
2022-02-05 15:22:59 +01:00
2022-02-25 00:09:14 +01:00
2022-01-20 10:50:17 -10:00
2022-02-14 14:54:55 +01:00
2022-02-10 14:51:29 +01:00
2022-02-25 12:33:09 +01:00