transformers
Fix tensor indexing crash in serve generate_response KV cache continuation
#44735
Merged
Merged
Fix tensor indexing crash in serve generate_response KV cache continuation #44735
LysandreJik
merged
2 commits into
huggingface:main
from
mango766:fix/serve-response-kv-cache-continuation
Fix tensor indexing crash in serve generate_response KV cache continu…
2cf1ea1d
LysandreJik
approved these changes
on 2026-03-16
Merge branch 'main' into fix/serve-response-kv-cache-continuation
0166003b
Login to write a write a comment.
Login via GitHub