PR #2991 speculative : add grammar support

speculative : add grammar support #2991

ggerganov merged 9 commits into master from speculative-grammar

ggerganov requested a review from

ejones 2 years ago

ggerganov force pushed from 3773d8c4 to f4682eea 2 years ago

ggerganov force pushed from f4682eea to 11b20504 2 years ago

ggerganov marked this pull request as ready for review 2 years ago

ejones commented on 2023-09-03

speculative : add grammar support

69f2fafe

grammars : add json_arr.gbnf

e0a8658e

grammar : add comments to new grammar file

2d89da4f

grammar : remove one nested level

01345788

common : warm-up with 2 tokens - seems to work better

ebe41d49

speculative : print draft token pieces

6c150d76

speculative : reuse grammar parser + better logs and comments

e7dc5b08

speculative : avoid grammar_mem

2db2471c

make : fix speculative build

c79d130f

ggerganov force pushed from ba199d84 to c79d130f 2 years ago

ejones approved these changes on 2023-09-05

ggerganov merged 92177210 into master 2 years ago

Reviewers

ejones

Assignees

No one assigned

Labels

None yet

Milestone

No milestone