Megatron-DeepSpeed
Alibi Tensor Parallel Fix
#244
Merged

Alibi Tensor Parallel Fix #244

DanielHesslow merged 6 commits into main from alibi_tp
DanielHesslow
DanielHesslow Alibi tensor parallel fix
32109206
DanielHesslow Tensor Parallel Test
28e2057b
DanielHesslow DanielHesslow requested a review from stas00 stas00 4 years ago
DanielHesslow DanielHesslow requested a review from thomasw21 thomasw21 4 years ago
DanielHesslow Force mp_start_method and disable git_ds_info
d5fa0709
stas00
DanielHesslow change port
1b7bd0dd
stas00
DanielHesslow
stas00
stas00 approved these changes on 2022-02-01
stas00
DanielHesslow spelling
d2a86710
thomasw21
thomasw21 commented on 2022-01-31
DanielHesslow minor refactoring + cleanup
87e75d26
thomasw21
thomasw21 commented on 2022-02-01
DanielHesslow DanielHesslow merged 40e8b2a0 into main 4 years ago
DanielHesslow DanielHesslow deleted the alibi_tp branch 4 years ago
stas00
DanielHesslow
stas00

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone