llama.cpp
Server: fallback to chatml, add AlphaMonarch chat template
#5628

Merged

Server: fallback to chatml, add AlphaMonarch chat template #5628

ggerganov merged 5 commits into ggml-org:master from ngxson:xsn/fix_server_chat_template

server: fallback to chatml

9576df90

add new chat template

b599545e

ngxson requested a review from

ggerganov 1 year ago

ggerganov commented on 2024-02-21

server: add AlphaMonarch to test chat template

10d86733

server: only check model template if there is no custom tmpl

2ab9cb96

ngxson requested a review from

ggerganov 1 year ago

remove TODO

f6b2e1d8

ggerganov approved these changes on 2024-02-22

ggerganov merged a46f5074 into master 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone