llama.cpp
Prefilling assistant message in openai compatible API
#13174

Merged

Prefilling assistant message in openai compatible API #13174

ngxson merged 7 commits into ggml-org:master from matteoserva:prefill

Prefilling assistant message in openai compatible API

e8291736

matteoserva requested a review from

ngxson 266 days ago

github-actions added examples

github-actions added server

fixed indentation

9d96e5ca

ngxson commented on 2025-04-29

fixed code convention

496f08e5

simplify method usage

79eb8257

ngxson commented on 2025-04-29

no more than one assistant message at end of messages

0c316cde

ngxson commented on 2025-04-29

merge checks into prefill code

cb7fe049

ngxson commented on 2025-04-29

Update examples/server/utils.hpp

836015d4

ngxson approved these changes on 2025-04-29

ngxson merged e2e1ddb9 into master 266 days ago

mango5343 approved these changes on 2025-07-25

Reviewers

ngxson

mango5343

Assignees

No one assigned

Labels

examples server

Milestone

No milestone