transformers
enable static cache on TP model
#39164
Merged
Overview
Commits
14
Changes
View On GitHub

enable static cache on TP model #39164

ArthurZucker merged 14 commits into huggingface:main from jiqing-feng:tp
jiqing-feng
jiqing-feng enable static cache on TP model
9b3ce7e9
jiqing-feng Merge branch 'huggingface:main' into tp
4c9182a4
jiqing-feng
yao-matrix
yao-matrix approved these changes on 2025-07-03
jiqing-feng jiqing-feng marked this pull request as ready for review 167 days ago
jiqing-feng
jiqing-feng check tp size before init kv cache
1b3fa74d
jiqing-feng Merge branch 'main' into tp
256f6b84
jiqing-feng fix docstring
be99fdfe
jiqing-feng Merge branch 'main' into tp
cec365ed
jiqing-feng Merge branch 'main' into tp
4480a809
jiqing-feng
jiqing-feng Merge branch 'main' into tp
8df07a2b
SunMarc
SunMarc commented on 2025-07-04
SunMarc SunMarc requested a review from gante gante 165 days ago
SunMarc SunMarc requested a review from ArthurZucker ArthurZucker 165 days ago
gante
gante commented on 2025-07-04
ArthurZucker
ArthurZucker commented on 2025-07-04
jiqing-feng Merge branch 'main' into tp
2d08276b
jiqing-feng
jiqing-feng
jiqing-feng
jiqing-feng add tp tests
ffd1cb1c
jiqing-feng fix comment
6f0b1d05
jiqing-feng Merge branch 'main' into tp
d47a59d7
ArthurZucker
ArthurZucker
ArthurZucker
ArthurZucker approved these changes on 2025-07-09
jiqing-feng
jiqing-feng Merge branch 'main' into tp
f12f3ad0
HuggingFaceDocBuilderDev
jiqing-feng
jiqing-feng fix other cache head size
2c1f36de
ArthurZucker ArthurZucker enabled auto-merge (squash) 160 days ago
ArthurZucker
ArthurZucker ArthurZucker merged aff7df84 into main 160 days ago
jiqing-feng jiqing-feng deleted the tp branch 2 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum