llama.cpp
ggml : remove KQ mask padding
#16309
Open

ggml : remove KQ mask padding #16309

ggerganov wants to merge 6 commits into master from gg/fa-no-kq-pad
ggerganov
ggerganov metal : pad K, V and Mask when needed
5d0d2d22
ggerganov cont : simplify
66692977
ggerganov cuda : add TODO about KV padding requirement
06294376
ggerganov metal : add comments
50d2b21d
ggerganov metal : remove mask padding requirement
46c338fc
ggerganov ggml : remove KQ mask padding
837b1b45
github-actions github-actions added ggml
jeffbolznv
jeffbolznv
slaren
ggerganov
Base automatically changed from gg/fa-kv-pad to master 4 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone