Dist testing backend fixes, etc. #708
jeffra
merged
9 commits into
master
from
jeffra/dist_changes
add support for passing init_method to distributed backend
da0bae46
make args.local_rank optional for engine, update docs
f3a78ffc
int cast rank
10e4dcc0
use fmt string
b62e24f2
remove args.local_rank assert and remove adding local rank on ds args…
dae5d557
refactor some tests related to local rank
9c11f10d
comment out some backward tests (based on discussion with @RezaYazdan…
4584704c
remove empty_grad=True, if zero-2 enabled this will cause a hang
9d6326d3
tjruwase
commented
on 2021-01-28
tjruwase
approved these changes
on 2021-01-28
refactor to address comment
721013bf
g-karthik
commented
on 2021-02-15
g-karthik
commented
on 2021-02-15
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub