llama.cpp
metal : optimize multi-sequence FA vec kernel
#13493
Merged

metal : optimize multi-sequence FA vec kernel #13493

ggerganov merged 2 commits into master from gg/metal-fa-vec-mask-opt
ggerganov
ggerganov batched-bench : fix pp batch contents
f078c798
ggerganov metal : optimize multi-sequence FA vec kernel
fdfc7de7
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
ggerganov
JohannesGaessler
JohannesGaessler
JohannesGaessler
JohannesGaessler
ggerganov
JohannesGaessler
ggerganov
Base automatically changed from gg/batched-bench-fix-pp to master 260 days ago
ggerganov ggerganov merged c252e0c4 into master 260 days ago
ggerganov ggerganov deleted the gg/metal-fa-vec-mask-opt branch 260 days ago
JohannesGaessler
ggerganov

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone