Skip to content

Commit ca8c540

Browse files
authored
Adds more collectives to ProcessGroups (#108)
* initial commit for reduce_scatter * fixes reduce_scatter function signature, refactors test and adds reduce_scatter test * fixes test * adds explicit NotImplementedError to reduce_scatter in gloo, simplify the test suite * fix tests after merge * initial commit * Added all collectives, starting tests now * fixes allreduce test, add and debug allgather_into_tensor_coalesced * added all tests, need to hammer out failures * fixes the tests * linter * test simplification * more cleanup * refactor + update tests * add reduce_scatter multi pg tests * add the full test suite * final cleanups * add _assert_list and _maybe_share_tensors
1 parent f44aaa5 commit ca8c540

File tree

2 files changed

+381
-106
lines changed

2 files changed

+381
-106
lines changed

0 commit comments

Comments
 (0)