DeepSpeed
0f05ee44 - Add Ulysses SP support for FLA gated-delta context parallelism

Commit

34 days ago

Add Ulysses SP support for FLA gated-delta context parallelism Signed-off-by: Xinyu Lian <lian7@illinois.edu>

References

Author

xylian86

Committer

sfc-gh-xlian

Parents