ggerganov/llama.cpp

Pull Requests Commits

cont : clean up grammar a bit

aldehir committed 1 hour ago

5746cc7b

chat : improve schema support in qwen3 parser

aldehir committed 1 hour ago

33231ab2

common : implement common_schema internal representation for JSON schemas (#28736)

aldehir committed 1 hour ago

Verified acecd560

jinja : support dot property integer literals (#28817)

CISC committed 2 hours ago

Verified ae9afff8

cmake: leave the timestamp out of precompiled headers on clang (#28816)

ServeurpersoCom committed 2 hours ago

Verified 737e0980

ui : add cache (#28802)

angt committed 8 hours ago

Verified 3057bb66

server : allow model downloads at model limit fix issue #26809 (#28530)

chenmiaoming committed 13 hours ago

Verified 56381e40

ggml-cuda: hip add specific config table for AMD GCN (#27841)

thelittlefireman committed 13 hours ago

Verified c8edceb0

server : add missing headers (#28795)

angt committed 13 hours ago

Verified e192abb4

vendor : update cpp-httplib to 0.56.0 (#28787)

cabelo committed 15 hours ago

Verified 718f7b41

syscl : Handle (fail gracefully) unsupported tq1_0 quants (#28681)

mctylr-gh committed 15 hours ago

Verified 2a3005c2

rpc : fix linking when compiling with BUILD_SHARED_LIBS=OFF (#28492)

EAddario committed 16 hours ago

Verified f3a33dff

server: frame the router child state command as a whole line (#28747)

ServeurpersoCom committed 17 hours ago

Verified c069aa7f

opencl: fix several bugs where the backend aborts (#27630)

wanghqc committed 17 hours ago

Verified 8a56aedd

opencl: add bin kernel `kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin` (#28677)

shaofeiqi committed 17 hours ago

Verified 07fc9771

webgpu: align tensor bindings to the type block size (#28382)

ServeurpersoCom committed 18 hours ago

Verified 3f5e94d7

hexagon: support for multi-device model split (aka row-split) (#28589)

max-krasnyansky committed 19 hours ago

Verified eafe15a5

ggml-webgpu: Update to a recent version of Dawn (#28683)

MendyBerger committed 21 hours ago

Verified d3146f2b

server: refactor subproc handling (#28555)

ngxson committed 1 day ago

Verified 82d6bb28

cmake : skip PCH for llama-server PCH when using MSVC (#28763)

danbev committed 1 day ago

Verified 8ea29024

ci : run test-backend-ops as a dedicated ci/run.sh test (#28740)

ggerganov committed 1 day ago

Verified b78a39a2

tests: extend test-quantize-fns to test nrc=2 (i8mm) kernels (#16234)

Rohanjames1997 committed 1 day ago

Verified 982937a3

tests: tolerate a shared pool abort in test_completion_unified (#28759)

ServeurpersoCom committed 1 day ago

Verified 8172e657

ggml: skip 0-sized ids tensor when offloading selected experts (#28739)

am17an committed 1 day ago

Verified 43f3dda6

metal : skip the empty half of the mul_mm_id token tile (#28301)

masterFoad committed 1 day ago

Verified 5bda51bf

cmake : add PCH and unity build to improve build times (#28091)

danbev committed 1 day ago

Verified 3bcfeb70

common : fix typo in speculative.cpp comment [no ci] (#28750)

danbev committed 1 day ago

Verified 1dfe94e0

metal : single-source fusion table + fusion debug rework (#28164)

ggerganov committed 1 day ago

Verified a2878d30

metal : fix idle threads in the remaining iq mul_mv kernels for ne00 < 1024 (#28692)

masterFoad committed 1 day ago

Verified aac81023

model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (#28630)

LoganChu committed 1 day ago

Verified 5cdd3d1d

Older