llama.cpp
common: "Profile Guided Speculative Decoding"
#17034
Open
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
3
Changes
View On
GitHub
common: "Profile Guided Speculative Decoding"
#17034
jukofyork
wants to merge 3 commits into
ggml-org:master
from
jukofyork:spec-decode
Add ability to use look-ahead
8c406738
Improved comments
95bde74f
Merge branch 'ggml-org:master' into spec-decode
13b86bbb
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub