transformers
Fix data-dependent branch in _ignore_causal_mask_sdpa under compile
#49354

Merged

Fix data-dependent branch in _ignore_causal_mask_sdpa under compile #49354

vasqu merged 4 commits into main from fix-static-cache-prefill-mask-graph-break

fix(masking): don't read a traced q_offset when skipping the causal mask

523e6b5e

Merge branch 'main' into fix-static-cache-prefill-mask-graph-break

130636b2

dacorvo requested a review from

Cyrilvallez 8 days ago

dacorvo removed review request from

Cyrilvallez 8 days ago

dacorvo requested a review from

vasqu 8 days ago

dacorvo requested a review from

Cyrilvallez 8 days ago

vasqu commented on 2026-10-07

vasqu approved these changes on 2026-10-08

Move the traced q_offset check next to the padding mask one

31330106

Split the traced q_offset check into its own condition

b6ecae4a

vasqu commented on 2026-10-08

vasqu enabled auto-merge 7 days ago

vasqu merged 65957315 into main 7 days ago

vasqu deleted the fix-static-cache-prefill-mask-graph-break branch 7 days ago

Reviewers

vasqu

Cyrilvallez

Assignees

No one assigned

Labels

None yet

Milestone

No milestone