transformers
Fix QuantizedCache residual flushing for multi-token updates
#49418
Merged
Merged
Fix QuantizedCache residual flushing for multi-token updates #49418
zucchini-nlp
merged
1 commit into
huggingface:main
from
LE0-Lin:fix/quantized-cache-chunk-flush
Fix quantized cache residual flushing for multi-token updates
3d0d518d
zucchini-nlp
commented
on 2026-10-08
zucchini-nlp
approved these changes
on 2026-10-08
Login to write a write a comment.
Login via GitHub