context : reserve new scheduler when graph topology changes #18547
ggerganov
wants to merge
11 commits into
master
from
gg/llama-reserve
danbev
approved these changes
on 2026-01-02
Base automatically changed from
gg/metal-adjust-fa-extra-size
to
master
12 days ago
context : reserve new scheduler when graph topology changes
e115c637
cont : fix
7b526420
cont : fix reserve
94426b2e
cont : reserve only when changes occur + timing
03e9d66c
context : add comments
5260bb79
llama : reserve on sampler changes
0c0d0fdc
common : allow null common_sampler
b579b970
server : task declares needs (embd, logits, sampling)
ffa0d15e
server : do not init sampler if not needed
be9e6ef2
llama : fix need_reserve when unsetting a sampler
3084bfe6
server : consolidate slot reset/clear logic
d9146ed2
Login to write a write a comment.
Login via GitHub