PR #7644 More checks before assuming FIM tokens

More checks before assuming FIM tokens #7644

ggerganov merged 4 commits into ggml-org:master from CISC:non-llama-fim-fix

More checks before assuming FIM tokens for Llama arch

998d208e

Merge branch 'ggerganov:master' into non-llama-fim-fix

29a98840

mofosyne added Review Complexity : Low

mofosyne added bugfix

mofosyne added medium severity

mofosyne approved these changes on 2024-05-30

mofosyne added merge ready

ggerganov commented on 2024-06-03

extensive token check

f75eedf7

CISC requested a review from

ggerganov 1 year ago

CISC changed the title ~~More checks before assuming FIM tokens for Llama arch~~ More checks before assuming FIM tokens 1 year ago

Merge branch 'ggerganov:master' into non-llama-fim-fix

f4df3ffd

ggerganov merged 6fcd1331 into master 1 year ago

CISC deleted the non-llama-fim-fix branch 1 year ago

Reviewers

mofosyne

ggerganov

Assignees

No one assigned

Labels

bugfix Review Complexity : Low merge ready medium severity

Milestone

No milestone