Support batched embeddings #5466
ggerganov
merged
5 commits into
ggml-org:master
from
iamlemec:bert-batched
batched embedding: pool outputs by sequence id. updated embedding exa…
1549493e
bring back non-causal attention
f281d76f
embd : minor improvements
b650d4cb
Merge branch 'master' into HEAD
39d37045
llama : minor
f4cccb7e
ggerganov
approved these changes
on 2024-02-13
Login to write a write a comment.
Login via GitHub