fix static cache data type miss-match #34799
ArthurZucker
merged
14 commits into
huggingface:main
from
jiqing-feng:gptj
SunMarc
commented
on 2024-11-19
fix gptj data type missmatch
46d42a98
Merge branch 'main' into gptj
a13def90
jiqing-feng
changed the title
jiqing-feng
changed the title
add low precision static cache tests
abdfc2e8
fix format
4a5c0c6d
fix low-precision static cache tests
3d95f698
fix format
6a905563
avoid config change
1576f8bc
Merge branch 'main' into gptj
c14d36b4
SunMarc
approved these changes
on 2024-11-20
ArthurZucker
commented
on 2024-11-20
change data type convert in cache copy
0ce90bed
Merge branch 'main' into gptj
8bada772
SunMarc
commented
on 2024-11-21
fix comment
82d1c1ce
cast key value after k v out
3aae20e4
Merge branch 'main' into gptj
76d5ca30
Merge branch 'main' into gptj
c65261e8
ArthurZucker
approved these changes
on 2024-11-25
Login to write a write a comment.
Login via GitHub