llama.cpp
Grammar optimization: eliminate redundant grammar trees (~4x faster grammar sampling)
#6616
Merged
Overview
Commits
1
Changes
View On GitHub

Grammar optimization: eliminate redundant grammar trees (~4x faster grammar sampling) #6616

HanClinto merged 1 commit into ggml-org:master from HanClinto:gbnf-optimize-ambiguity2
HanClinto
github-actions
HanClinto Optimization: eliminate addition of redundant stacks when advancing g…
80553e53
HanClinto HanClinto force pushed from 3bbceb5f to 80553e53 1 year ago
HanClinto
HanClinto HanClinto changed the title Grammar Optimization: Eliminate Redundant Grammar Trees Grammar optimization: eliminate redundant grammar trees (~9x faster grammar sampling) 1 year ago
HanClinto HanClinto changed the title Grammar optimization: eliminate redundant grammar trees (~9x faster grammar sampling) Grammar optimization: eliminate redundant grammar trees (~4x faster grammar sampling) 1 year ago
ochafik
ochafik
ochafik commented on 2024-04-12
ochafik
ochafik approved these changes on 2024-04-12
HanClinto HanClinto merged 04a5ac21 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum