llama.cpp
common: "Profile Guided Speculative Decoding"
#17034
Open

common: "Profile Guided Speculative Decoding" #17034

jukofyork wants to merge 3 commits into ggml-org:master from jukofyork:spec-decode
jukofyork
jukofyork Add ability to use look-ahead
8c406738
jukofyork Improved comments
95bde74f
jukofyork Merge branch 'ggml-org:master' into spec-decode
13b86bbb
jukofyork

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone