22 Commits

Author	SHA1	Message	Date
Xinlei Chen	1c6b717e55	start readme	2021-07-08 15:51:00 -07:00
Xinlei Chen	02655ae4d6	start readme	2021-07-08 15:31:55 -07:00
Xinlei Chen	1d76a72e35	start readme	2021-07-08 04:34:54 -07:00
Xinlei Chen	d04dcd5246	fix issues, add vit position embedding	2021-07-07 18:47:47 -07:00
Xinlei Chen	fe5f5a2395	only the first GPU saves checkpoint	2021-07-05 02:19:09 -07:00
Xinlei Chen	5018d1ceaa	fix init_lr	2021-07-01 14:00:25 -07:00
Xinlei Chen	f9e4464bf6	add a bunch of things	2021-06-27 03:22:50 -07:00
Xinlei Chen	caf32a1cf2	in-progress: add vit to linear	2021-06-25 05:49:34 -07:00
Xinlei Chen	724164512a	in-progress: add vit	2021-06-24 14:17:56 -07:00
Xinlei Chen	ae95fdc282	in-progress: add vit	2021-06-24 03:44:50 -07:00
Xinlei Chen	752a356674	add mixed precision	2021-06-23 23:59:26 -07:00
Xinlei Chen	0ec146f8eb	add momentum schedule	2021-06-23 23:26:16 -07:00
Xinlei Chen	a9b3a1e0a6	remove nesterov	2021-06-21 17:52:28 -07:00
Xinlei Chen	da1b6b75d4	sync before training so it does not get stuck.	2021-06-19 02:59:06 -07:00
Xinlei Chen	89d29d8b64	slurm	2021-06-18 16:20:47 -07:00
Xinlei Chen	54e9e6174f	multi-node is working?	2021-06-18 16:18:22 -07:00
Xinlei Chen	9394161a7a	after debugging	2021-06-17 12:31:27 -07:00
Xinlei Chen	2e39594e12	add warmup	2021-06-17 03:20:50 -07:00
Xinlei Chen	6b7caf4089	add nesterov	2021-06-17 03:06:05 -07:00
Xinlei Chen	efbc756baa	get it running	2021-06-17 02:39:28 -07:00
Xinlei Chen	dacd917eb7	add moco v3	2021-06-17 02:09:43 -07:00
Xinlei Chen	0b658b95cf	add initial files	2021-06-16 19:59:59 -07:00