llama.cpp
`sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string)
#12291

Merged

`sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string) #12291

ochafik merged 2 commits into ggml-org:master from ochafik:fix-trig-tok

Fix typo in lazy grammar handling (fixes trigger tokens)

cb794527

ochafik changed the title ~~Fix typo in lazy grammar handling (fixes trigger tokens)~~ `sampler`: fix typo in lazy grammar handling (fixes trigger tokens) 1 year ago

github-actions added examples

github-actions added server

ochafik marked this pull request as ready for review 1 year ago

ochafik requested a review from

ngxson 1 year ago

ochafik changed the title ~~`sampler`: fix typo in lazy grammar handling (fixes trigger tokens)~~ `sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string) 1 year ago

ggerganov commented on 2025-03-10

ggerganov approved these changes on 2025-03-10

Update examples/server/server.cpp

eb9639ed

ochafik merged 2b3a25c2 into master 1 year ago

ochafik deleted the fix-trig-tok branch 1 year ago

Reviewers

ggerganov

ngxson

Assignees

No one assigned

Labels

examples server

Milestone

No milestone

llama.cpp `sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string) #12291 Merged

`sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string) #12291

llama.cpp
`sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string)
#12291

Merged