cuda : add F32 -> Q8_0 copy kernel - SemanticDiff

Commit

2 years ago

cuda : add F32 -> Q8_0 copy kernel ggml-ci

References

#4312 - llama : support quantum K cache

Author

ggerganov

ggerganov

Committer

ggerganov

ggerganov

Parents

Loading