llama.cpp
server : add realtime conversation and transcription on /v1/realtime
#31269
Merged
Merged
server : add realtime conversation and transcription on /v1/realtime #31269
ngxson
merged
6 commits into
ggml-org:master
from
tdakhran:tarek/lfm3/upstream/4-realtime
server : add realtime conversation and transcription on /v1/realtime
9d4d95b0
examples : default the realtime client to the server port 9931
27627982
server : sample realtime responses right after their own decode
e3aaf85a
move more stuff to server-realtime, making it self-contained
dafc1135
examples : fix the type check of the realtime client
b0b52f77
examples : use the model card prompts in the realtime client
711e9c9e
Reviewers
No reviews
Assignees
No one assigned
Labels
documentation
server
Milestone
No milestone
Login to write a write a comment.
Login via GitHub