DeepSpeed
KV Cache Improved Flexibility
#4668
Merged

KV Cache Improved Flexibility #4668

awan-10 merged 5 commits into master from cholmes/kv-cache-flexibility
cmikeh2
cmikeh2 Initial implementation
8450156d
cmikeh2 Passing unit tests
f1911462
cmikeh2 Formatting
58cf675f
cmikeh2 cmikeh2 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
cmikeh2 cmikeh2 requested a review from jeffra jeffra 2 years ago
cmikeh2 cmikeh2 requested a review from mrwyattii mrwyattii 2 years ago
cmikeh2 cmikeh2 requested a review from awan-10 awan-10 2 years ago
cmikeh2 cmikeh2 requested a review from arashb arashb 2 years ago
cmikeh2 cmikeh2 requested a review from tjruwase tjruwase 2 years ago
tjruwase Merge branch 'master' into cholmes/kv-cache-flexibility
21b2b021
cmikeh2 Merge remote-tracking branch 'origin/master' into cholmes/kv-cache-fl…
2de9ef5a
awan-10
awan-10 approved these changes on 2023-11-14
awan-10 awan-10 merged 901d8070 into master 2 years ago
jeffra
jeffra commented on 2023-11-16

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone