DeepSpeed
44fcc76b - Add Ulysses SP support for FLA gated-delta context parallelism
Commit
View On GitHub
Commit
43 days ago
Add Ulysses SP support for FLA gated-delta context parallelism Signed-off-by: Xinyu Lian <lian7@illinois.edu>
Author
xylian86 xylian86
Committer
xylian86 xylian86
Parents
ac5c49f5
FAQ Terms Privacy Refunds Impressum
Loading