PR #12563 ulysses enabling in native attention path

ulysses enabling in native attention path #12563

yiyixuxu merged 6 commits into huggingface:main from sywangyi:ulysses-native

ulysses enabling in native attention path

109d2dd6

sywangyi force pushed from d6256ab7 to 109d2dd6 112 days ago

sayakpaul approved these changes on 2025-10-30

sayakpaul requested a review from

DN6 112 days ago

address review comment

146cd6dd

DefTruth requested changes on 2025-10-31

add supports_context_parallel for native attention

0894b52a

Merge branch 'main' into ulysses-native

19ef5d78

yiyixuxu commented on 2025-11-01

update templated attention

31b2c545

Merge branch 'main' into ulysses-native

0340d3b8

yiyixuxu approved these changes on 2025-11-03

yiyixuxu added context-parallel

yiyixuxu merged 1ec28a2c into main 108 days ago

Reviewers

yiyixuxu

sayakpaul

DefTruth

DN6

Assignees

No one assigned

Labels

context-parallel

Milestone

No milestone