Fix DogeForCausalLM attending to future tokens under sdpa #48770
Omarinho12345
wants to merge
1 commit into
huggingface:main
from
Omarinho12345:fix/doge-sdpa-causal-mask
fix: always materialize causal mask for Doge (sdpa future-token leak)
4c9d2410
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub