mirrors/mmengine
1
0
Fork 0
mirror of https://github.com/open-mmlab/mmengine.git synced 2025-06-03 21:54:44 +08:00
Code Issues Projects Releases Wiki Activity

[Enhance] Make sure Tensors to broadcast is contiguous (#948)

Browse Source 
* Make sure Tensors to cast is contiguous

* simplify

---------

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
This commit is contained in:
Weihang Xia 2023-02-22 11:41:06 +08:00 committed by GitHub
parent e271454527
commit 8370c1e7f7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
mmengine/dist/dist.py vendored
View File

@ -307,7 +307,8 @@ def broadcast(data: Tensor,
input_device = get_data_device(data)
backend_device = get_comm_device(group)
data_on_device = cast_data_device(data, backend_device)
# broadcast requires tensor is contiguous
data_on_device = data_on_device.contiguous() # type: ignore
torch_dist.broadcast(data_on_device, src, group)
if get_rank(group) != src: