llama.cpp
context : do not re-reserve the scheduler when toggling causal_attn
#28751
Merged

context : do not re-reserve the scheduler when toggling causal_attn #28751

sihanyu03
sihanyu03 sihanyu03 requested a review from ggerganov ggerganov 48 days ago
am17an
sihanyu03
am17an
ddh0
sihanyu03 sihanyu03 requested a review from CISC CISC 45 days ago
github-actions github-actions added model
sihanyu03
sihanyu03
sihanyu03 sihanyu03 force pushed 42 days ago
sihanyu03
am17an
sihanyu03 context : do not re-reserve the scheduler when toggling causal_attn
f96b0b76
sihanyu03 qwen4exp : make the indexer bias shape independent of causal_attn
b4431a7c
sihanyu03 context : state the causal_attn shape rule in the comment
0cbdaaf9
sihanyu03 sihanyu03 force pushed to 0cbdaaf9 37 days ago
sihanyu03
sihanyu03
am17an
sihanyu03
am17an
am17an approved these changes on 2026-09-28
ggerganov
am17an
sihanyu03
ggerganov cont : add TODOs
d0650c78
ggerganov
ggerganov approved these changes on 2026-09-28
ggerganov ggerganov added merge ready
am17an
ggerganov
am17an
ggerganov ggerganov merged ed7ac35e into master 31 days ago
sihanyu03 sihanyu03 deleted the context-causal-attn-no-rereserve branch 31 days ago
ggerganov
am17an
sihanyu03
sihanyu03
ggerganov
am17an
sihanyu03
ggerganov

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone