ggml-org/llama.cpp

Pull Requests Commits

cont : simplify

ggerganov committed 51 days ago

Verified c8f8e236

am17an committed 51 days ago

c417ddfc

spec: support MTP

am17an committed 51 days ago

a428b010

spec : introduce `common_speculative_process()`

ggerganov committed 52 days ago

Verified db8e3269

spec : reset `drafting` flag at the end

ggerganov committed 52 days ago

Verified 0d5dd61d

ggerganov committed 52 days ago

Verified ec8bc448

cont : clean-up

ggerganov committed 53 days ago

Verified b3bd3bd4

server, spec : clean-up

ggerganov committed 53 days ago

Verified ce0acf03

llama : reuse device buffers when possible

ggerganov committed 53 days ago

Verified 55b62bce

server : support parallel drafting

ggerganov committed 53 days ago

Verified f1652197

spec : support parallel drafts

ggerganov committed 53 days ago

Verified f88c9428

cont : prepare params

ggerganov committed 53 days ago

Verified 927d6635

cont : prepare params

ggerganov committed 53 days ago

Verified 8822c122

spec : refactor for multi-sequence speculative context

ggerganov committed 54 days ago

Verified 6582523e

naming : improve consistency

ggerganov committed 54 days ago

Verified efa2f8e5

tools : update readme

ggerganov committed 54 days ago

Verified 778f9e24

server : fix slot ctx_drft ptr

ggerganov committed 54 days ago

Verified 1dbc054d

spec : fix n_past type

ggerganov committed 54 days ago

Verified 161eae0a

speculative-simple : update

ggerganov committed 54 days ago

Verified e5b14013

server : clean-up + dry

ggerganov committed 54 days ago

Verified 3b1a8df8

server : add comment

ggerganov committed 54 days ago

Verified 233d1aee

server : fix URL for draft model

ggerganov committed 54 days ago

Verified 12c7cfbe

server : fix mtmd draft processing

ggerganov committed 54 days ago

Verified 6a4b05a0

spec : handle draft running out of context

ggerganov committed 54 days ago

Verified 8be14e40

cont : process images throught the draft context

ggerganov committed 54 days ago

Verified 7e118cdc

cont : pass correct n_past for drafting

ggerganov committed 54 days ago

Verified ae6703fa

cont : handle non-ckpt models

ggerganov committed 54 days ago

Verified 0239f4c6

cont : async drft eval when possible

ggerganov committed 54 days ago

Verified c7facb0f

cont : sync main and drft contexts

ggerganov committed 54 days ago

Verified 08c8012b

server, spec : transition to unified spec context

ggerganov committed 54 days ago

Verified de35b125

Older