transformers
Cache: Static cache as a standalone object
#30476
Merged

Cache: Static cache as a standalone object #30476

gante merged 12 commits into huggingface:main from gante:static_cache_v2
gante
gante gante requested a review from ArthurZucker ArthurZucker 2 years ago
ArthurZucker
ArthurZucker commented on 2024-04-25
ArthurZucker
HuggingFaceDocBuilderDev
ArthurZucker
ArthurZucker
ArthurZucker
gante gante changed the title Cache: Static cache as a stand-alone object Cache: Static cache as a standalone object 2 years ago
poedator
poedator commented on 2024-04-26
gante gante marked this pull request as ready for review 2 years ago
younesbelkada
younesbelkada commented on 2024-04-26
gante gante force pushed 2 years ago
gante working :D
fa0b05e0
gante tmp commit
56cf73b2
gante working on generate too; make fixup
97aa785b
gante dbrx
a6853a19
gante missing in dbrx
326a1c74
gante more dbrx details; gemma
9de95566
gante tmp
90771df1
gante finalized mvp
cd6aecd7
gante gante force pushed to cd6aecd7 2 years ago
gante test for different cuda compute capabilities
b8caa5e1
gante missing doc entry
16e01f2d
ArthurZucker
ArthurZucker approved these changes on 2024-04-29
gante tmp commit
2d1eab83
gante final nits
bb159d29
gante gante merged 75bbfd5b into main 2 years ago
gante gante deleted the static_cache_v2 branch 2 years ago
ArthurZucker
ArthurZucker commented on 2024-05-14

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone