llama.cpp
Grammar optimization: eliminate redundant grammar trees (~4x faster grammar sampling)
#6616

Merged

Commits

Optimization: eliminate addition of redundant stacks when advancing grammar.

HanClinto committed 2 years ago

Loading