llama.cpp
context : allow cache-less context for embeddings
#13108
Merged

context : allow cache-less context for embeddings #13108

ggerganov merged 7 commits into master from gg/embeddings-no-kv
ggerganov
github-actions github-actions added examples
github-actions github-actions added server
Base automatically changed from gg/llama-kv-cache-v6 to master 1 year ago
ggerganov
Green-Sky
Green-Sky commented on 2025-05-02
ggerganov context : allow cache-less context for embeddings
9770efa3
ggerganov context : enable reranking with encode()
a21ff6c2
ggerganov context : encode() clears embd_seq
c14ee723
ggerganov ggerganov force pushed from 4f0ea9b3 to c14ee723 1 year ago
ggerganov examples : use llama_encode() when appropriate
c7092756
ggerganov models : nomic bert moe does not require KV cache
97b975d4
ggerganov llama : update comments for llama_decode/llama_encode
3b4f6c0e
ggerganov ggerganov marked this pull request as ready for review 1 year ago
ggerganov ggerganov requested a review from ngxson ngxson 1 year ago
ggerganov context : update warning log [no ci]
abe25e7d
aviallon
ggerganov ggerganov merged 6562e5a4 into master 1 year ago
ggerganov ggerganov deleted the gg/embeddings-no-kv branch 1 year ago
aviallon
aviallon commented on 2025-05-09
cebtenzzre
ggerganov
cebtenzzre
ggerganov
ggerganov

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone