DeepSpeed
72913bee - Revert "Fix the bug of deepspeed sequence parallel working with batch size larger than 1 (#5823)"

Commit

1 year ago

Revert "Fix the bug of deepspeed sequence parallel working with batch size larger than 1 (#5823)" This reverts commit ffe0af23575c4f03a07408eacfc50b1a58781429.

References

loadams/test-nv-torch-latest-v100

Author

loadams

Parents

ffe0af23

DeepSpeed 72913bee - Revert "Fix the bug of deepspeed sequence parallel working with batch size larger than 1 (#5823)"

DeepSpeed
72913bee - Revert "Fix the bug of deepspeed sequence parallel working with batch size larger than 1 (#5823)"