transformers.js
Cached generation improvements (+ past_key_values via pipeline function)
#1638
Merged
Merged
Cached generation improvements (+ past_key_values via pipeline function) #1638
xenova
merged
15 commits into
main
from
multimodal-pkv-improvements
add `multi-turn with past_key_values matches without` test
a7b566d2
Add dynamic cache sequence length retrieval test
7a6e867f
sequence length = 0 if empty
1b9a414e
Create DynamicCache update method
83a06e90
Remove private PreTrainedModel functions & use new methods
e63e3075
Align with python transformers: load_audio instead of read_audio
04aff517
Add past_key_values to possible generation config parameters
cbfd1db4
Add test case for past_key_values type
9960f76b
Type improvements
b965057e
Far better error messages!
f3731ee9
Improve typescript tests
f95f3720
Apply same typescript improvements to other pipelines
afe4d61f
new typescript tests
e3460168
Update preprocess.js
58405777
improve error message
00a8fb52
nico-martin
approved these changes
on 2026-04-13
Login to write a write a comment.
Login via GitHub