sample grammar perf #4330
ggerganov
merged
10 commits into
ggml-org:master
from
MarcusDunn:precompute-peice
reserve space for codepoints
2e5c8aea
Merge branch 'ggerganov:master' into master
a4b7b4c3
improvement for the appended 0
9d3ba0ba
Merge branch 'ggerganov:master' into master
911a8719
used precomputed token text for grammar sample
5dd1f45e
reserve canidates_decoded
7cd0d323
reserve canidates_grammar
eb9d1fcd
remove candidates_decoded
37733280
Revert "remove candidates_decoded"
71596272
changed decode_utf8 to take src by ref
b629ede6
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub