llama.cpp
llama : improve infill support and special token detection
#9798

Merged

llama : improve infill support and special token detection #9798

ggerganov merged 4 commits into master from gg/infill-0

github-actions added examples

github-actions added server

ggerganov force pushed 1 year ago

ggerganov force pushed to 61a66f25 1 year ago

CISC commented on 2024-10-09

llama : improve infill support

3a8a89ac

llama : add more FIM token strings

0fb9c91f

server : update prompt on slot restore (#9800)

3ae86704

gguf : deprecate old FIM token KVs

36815404

ggerganov force pushed to 36815404 1 year ago

github-actions added python

ggerganov changed the title ~~llama : improve infill support~~ llama : improve infill support and special token detection 1 year ago

ggerganov merged 11ac9800 into master 1 year ago

ggerganov deleted the gg/infill-0 branch 1 year ago

Reviewers

CISC

Assignees

No one assigned

Labels

examples python server

Milestone

No milestone