DeepSpeed
Add Ulysses SP support for FLA gated-delta context parallelism
#8114

Open

Add Ulysses SP support for FLA gated-delta context parallelism #8114

xylian86 wants to merge 5 commits into master from xlian/linear-recurrent-cp

xylian86 force pushed from fb9213e3 to 2f95732d 125 days ago

xylian86 force pushed from 2f95732d to 6c7269a2 125 days ago

xylian86 force pushed from 6c7269a2 to b49edd21 125 days ago

xylian86 marked this pull request as ready for review 125 days ago

xylian86 requested a review from

tjruwase 125 days ago

xylian86 requested a review from

tohtana 125 days ago

xylian86 requested a review from

loadams 125 days ago

xylian86 force pushed from 368c1221 to 067f377d 125 days ago

chatgpt-codex-connector commented on 2026-07-02

tohtana requested changes on 2026-07-10

Add Ulysses SP support for FLA gated-delta context parallelism

0f05ee44

Fix Qwen3.5 Ulysses linear attention correctness

e3d04948

xylian86 force pushed from 225b3e1d to e3d04948 71 days ago

Harden Ulysses linear attention integration

687ecf6f

Expand Ulysses packed and lifecycle coverage

f31e5ebe

Document hybrid Ulysses metadata contracts

292ccd6a

Reviewers

tohtana

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone