llama : add grammar-based sampling #1773
ejones
merged
22 commits into
ggml-org:master
from
ejones:grammar
llama, main : constrain sampling to grammar
fd0eb663
allow loading grammar from file
834d423e
fix whitespace errors
9e77f42e
handle & print parser errors
674bb08b
add comments to grammar syntax and allow newlines where unambiguous
98a9587c
Merge remote-tracking branch 'refs/remotes/upstream/master' into grammar
56904cae
add missing include
3e78f007
support alternates in root rule
421c6e1c
fix bugs with empty token and EOS
b876d19c
adjust JSON grammar
58ca9bc6
remove swp file
414f2510
howard0su
commented
on 2023-06-15
SlyEcho
commented
on 2023-06-16
SlyEcho
commented
on 2023-06-16
ggerganov
commented
on 2023-06-17
rewrite ternary expressions
18e6221a
ggerganov
approved these changes
on 2023-06-18
ggerganov
changed the title 
use struct for grammar elements and add Unicode support
f8baad23
Merge remote-tracking branch 'upstream/master' into grammar
38fbd400
add unicode escapes
014fbfd4
Merge remote-tracking branch 'upstream/master' into grammar
b2e071dd
add inverse char ranges
8d37755b
only sample full tokens (no peeking or truncation)
c047e8ae
llama : minor style changes
11315b1d
ggerganov
approved these changes
on 2023-07-21
Merge remote-tracking branch 'upstream/master' into grammar
8145bca2
update help text
f7f1d266
add warning message if EOS is disabled
4cd9711d
Login to write a write a comment.
Login via GitHub