llama.cpp
lookahead : add example for lookahead decoding
#4207
Merged

lookahead : add example for lookahead decoding #4207

ggerganov merged 9 commits into master from lookahead
ggerganov
ggerganov lookahead : init
7c517e17
ggerganov lookahead : generate and store n-grams
eb03b9ad
ggerganov lookahead : use loop instead recursion to generate n-grams
1b2e0bc3
ggerganov lookahead : initial working implementation
61d03972
ggerganov lookahead : filter repeating n-grams
6eb5166e
ggerganov lookahead : use deterministic init
7bd1cd7e
ggerganov ggerganov marked this pull request as ready for review 1 year ago
slaren lookahead : add to Makefile
7d50de2d
slaren
ggerganov lookahead : fix a bug in the seq_id of the lookahead tokens
1a07a339
ggerganov lookahead : add comments
8d8b76d4
ggerganov
ggerganov ggerganov merged 922754a8 into master 1 year ago
Galunid
ggerganov
Galunid
yaoxingwei
alexvt-amz

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone