PR #13496 metal : use FA-vec kernel up to batch size 20

metal : use FA-vec kernel up to batch size 20 #13496

ggerganov merged 3 commits into master from gg/metal-fa-vec-bs20

batched-bench : fix pp batch contents

f078c798

metal : optimize multi-sequence FA vec kernel

fdfc7de7

metal : use FA-vec kernel up to batch size 20

78d70223

github-actions added ggml

github-actions added Apple Metal

Base automatically changed from gg/metal-fa-vec-mask-opt to master 178 days ago

ggerganov merged f0995d28 into master 178 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

ggml Apple Metal

Milestone

No milestone