Commit Graph

25 Commits (6a8c371a94466ad352a302b0d6d5ffb136af31d3)

Author SHA1 Message Date
Xinlei Chen 6a8c371a94 add back stop-grad 2021-07-09 02:22:59 -07:00
Xinlei Chen 6b1cc4cf87 remove ViT BN and simplify pipeline 2021-07-08 21:00:51 -07:00
Xinlei Chen c5b2e602eb start readme 2021-07-08 17:41:35 -07:00
Xinlei Chen 1c6b717e55 start readme 2021-07-08 15:51:00 -07:00
Xinlei Chen 02655ae4d6 start readme 2021-07-08 15:31:55 -07:00
Xinlei Chen 1d76a72e35 start readme 2021-07-08 04:34:54 -07:00
Xinlei Chen d04dcd5246 fix issues, add vit position embedding 2021-07-07 18:47:47 -07:00
Xinlei Chen fe5f5a2395 only the first GPU saves checkpoint 2021-07-05 02:19:09 -07:00
Xinlei Chen 5018d1ceaa fix init_lr 2021-07-01 14:00:25 -07:00
Xinlei Chen f9e4464bf6 add a bunch of things 2021-06-27 03:22:50 -07:00
Xinlei Chen caf32a1cf2 in-progress: add vit to linear 2021-06-25 05:49:34 -07:00
Xinlei Chen 724164512a in-progress: add vit 2021-06-24 14:17:56 -07:00
Xinlei Chen ae95fdc282 in-progress: add vit 2021-06-24 03:44:50 -07:00
Xinlei Chen 752a356674 add mixed precision 2021-06-23 23:59:26 -07:00
Xinlei Chen 0ec146f8eb add momentum schedule 2021-06-23 23:26:16 -07:00
Xinlei Chen a9b3a1e0a6 remove nesterov 2021-06-21 17:52:28 -07:00
Xinlei Chen da1b6b75d4 sync before training so it does not get stuck. 2021-06-19 02:59:06 -07:00
Xinlei Chen 89d29d8b64 slurm 2021-06-18 16:20:47 -07:00
Xinlei Chen 54e9e6174f multi-node is working? 2021-06-18 16:18:22 -07:00
Xinlei Chen 9394161a7a after debugging 2021-06-17 12:31:27 -07:00
Xinlei Chen 2e39594e12 add warmup 2021-06-17 03:20:50 -07:00
Xinlei Chen 6b7caf4089 add nesterov 2021-06-17 03:06:05 -07:00
Xinlei Chen efbc756baa get it running 2021-06-17 02:39:28 -07:00
Xinlei Chen dacd917eb7 add moco v3 2021-06-17 02:09:43 -07:00
Xinlei Chen 0b658b95cf add initial files 2021-06-16 19:59:59 -07:00