3 Commits (a39d959eeb644b5401e1e65edd1eaeb472abe2e4)

Author	SHA1	Message	Date
Zaida Zhou	0ca54eb71b	[Fix] Fix unit tests when gpu is not available (#163)	2022-04-01 12:50:15 +08:00
Zaida Zhou	f548c81846	[Enhancement] Handle tensor device type in sync_random_seed (#126)	2022-03-13 17:45:02 +08:00
Zaida Zhou	c6a8d72c5e	[Feature] Add distributed module (#59) ... * [Feature] Add distributed module * fix IS_DIST error * all_reduce_dict does operations in-place * support 'mean' operation * provide local group process * add tmpdir argument for collect_results * add unit tests * refactor unit tests * simplify steps to create multiple processes * minor fix * describe the different of *gather* in mmengine and pytorch * minor fix * add unit tests for nccl * test nccl backend in multiple gpu * add get_default_group function to handle different torch versions * minor fix * [Feature] Add distributed module * fix IS_DIST error * all_reduce_dict does operations in-place * support 'mean' operation * provide local group process * add tmpdir argument for collect_results * add unit tests * refactor unit tests * simplify steps to create multiple processes * minor fix * describe the different of *gather* in mmengine and pytorch * minor fix * add unit tests for nccl * test nccl backend in multiple gpu * add get_default_group function to handle different torch versions * minor fix * minor fix * handle torch1.5 * handle torch1.5 * minor fix * fix typo * refactor unit tests * nccl does not support gather and gather_object * fix gather * fix collect_results_cpu * fix collect_results and refactor unit tests * fix collect_results unit tests * handle torch.cat in torch1.5 * refine docstring * refine docstring * fix comments * fix comments	2022-03-05 22:03:32 +08:00