PR #9319 cuda : fix defrag with quantized KV

cuda : fix defrag with quantized KV #9319

slaren merged 1 commit into master from sl/fix-cuda-defrag

github-actions added Nvidia GPU

github-actions added ggml

cuda : fix defrag with quantized KV

e4629190

slaren force pushed to e4629190 1 year ago

ggerganov approved these changes on 2024-09-05

slaren merged 4db04784 into master 1 year ago

slaren deleted the sl/fix-cuda-defrag branch 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

Nvidia GPU ggml

Milestone

No milestone