ggerganov/llama.cpp

Pull Requests Commits

naming : improve consistency

ggerganov committed 34 days ago

Verified efa2f8e5

tools : update readme

ggerganov committed 34 days ago

Verified 778f9e24

server : fix slot ctx_drft ptr

ggerganov committed 34 days ago

Verified 1dbc054d

spec : fix n_past type

ggerganov committed 34 days ago

Verified 161eae0a

speculative-simple : update

ggerganov committed 34 days ago

Verified e5b14013

server : clean-up + dry

ggerganov committed 34 days ago

Verified 3b1a8df8

server : add comment

ggerganov committed 34 days ago

Verified 233d1aee

server : fix URL for draft model

ggerganov committed 34 days ago

Verified 12c7cfbe

server : fix mtmd draft processing

ggerganov committed 34 days ago

Verified 6a4b05a0

spec : handle draft running out of context

ggerganov committed 34 days ago

Verified 8be14e40

cont : process images throught the draft context

ggerganov committed 34 days ago

Verified 7e118cdc

cont : pass correct n_past for drafting

ggerganov committed 34 days ago

Verified ae6703fa

cont : handle non-ckpt models

ggerganov committed 34 days ago

Verified 0239f4c6

cont : async drft eval when possible

ggerganov committed 34 days ago

Verified c7facb0f

cont : sync main and drft contexts

ggerganov committed 34 days ago

Verified 08c8012b

server, spec : transition to unified spec context

ggerganov committed 34 days ago

Verified de35b125

server : improve ctx names

ggerganov committed 34 days ago

Verified 1afee5b2

server : draft prompt cache and checkpoints

ggerganov committed 34 days ago

Verified 11fd5e72

server : sketch the ctx_dft decode loop

ggerganov committed 34 days ago

Verified c97dc360

cont : dedup ctx_seq_rm_type

ggerganov committed 34 days ago

Verified 8a50f6f0

cont : pass seq_id

ggerganov committed 34 days ago

Verified 77269ad8

spec : update common_speculative_init()

ggerganov committed 34 days ago

Verified 4550f0f0

spec : drop support for incompatible vocabs

ggerganov committed 34 days ago

Verified befc7ef6

spec : refactor

ggerganov committed 34 days ago

Verified 2c9a4084

llama : fix device state save/load (#22805)

ggerganov committed 34 days ago

Verified e43431b3

opencl: add opfilter regex for debugging (#22782)

shaofeiqi committed 34 days ago

Verified ceb7e14b

common/chat : preserve media markers for typed-content templates (#22634)

aldehir committed 34 days ago

Verified 093be624

tests: add long-sequence cases and fix inputs for gated_delta_net (#22794)

Neroued committed 34 days ago

Verified deab41ec

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

aicss-genai committed 34 days ago

Verified ad092246

Write a readme on Multi-GPU usage in llama.cpp (#22729)

gaugarg-nv committed 34 days ago

Verified b9afc19c

Older