llama.cpp
server: support inp embd to generate next token
#26313

Merged

server: support inp embd to generate next token #26313

ngxson merged 2 commits into master from xsn/server_batch_embd

server: support embd for sampled token

d8625645

ngxson requested a review from

ggerganov 9 days ago

ngxson requested a review 9 days ago

github-actions added server

fix ~server_batch()

76bb9cb0

ggerganov approved these changes on 2026-07-30

ngxson merged b4ca032a into master 9 days ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

server

Milestone

No milestone