ggerganov/llama.cpp

Pull Requests Commits

server : add missing headers (#28795)

angt committed 11 days ago

Verified e192abb4

vendor : update cpp-httplib to 0.56.0 (#28787)

cabelo committed 11 days ago

Verified 718f7b41

syscl : Handle (fail gracefully) unsupported tq1_0 quants (#28681)

mctylr-gh committed 11 days ago

Verified 2a3005c2

rpc : fix linking when compiling with BUILD_SHARED_LIBS=OFF (#28492)

EAddario committed 11 days ago

Verified f3a33dff

server: frame the router child state command as a whole line (#28747)

ServeurpersoCom committed 11 days ago

Verified c069aa7f

opencl: fix several bugs where the backend aborts (#27630)

wanghqc committed 11 days ago

Verified 8a56aedd

opencl: add bin kernel `kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin` (#28677)

shaofeiqi committed 11 days ago

Verified 07fc9771

webgpu: align tensor bindings to the type block size (#28382)

ServeurpersoCom committed 11 days ago

Verified 3f5e94d7

hexagon: support for multi-device model split (aka row-split) (#28589)

max-krasnyansky committed 11 days ago

Verified eafe15a5

ggml-webgpu: Update to a recent version of Dawn (#28683)

MendyBerger committed 11 days ago

Verified d3146f2b

server: refactor subproc handling (#28555)

ngxson committed 12 days ago

Verified 82d6bb28

cmake : skip PCH for llama-server PCH when using MSVC (#28763)

danbev committed 12 days ago

Verified 8ea29024

ci : run test-backend-ops as a dedicated ci/run.sh test (#28740)

ggerganov committed 12 days ago

Verified b78a39a2

tests: extend test-quantize-fns to test nrc=2 (i8mm) kernels (#16234)

Rohanjames1997 committed 12 days ago

Verified 982937a3

tests: tolerate a shared pool abort in test_completion_unified (#28759)

ServeurpersoCom committed 12 days ago

Verified 8172e657

ggml: skip 0-sized ids tensor when offloading selected experts (#28739)

am17an committed 12 days ago

Verified 43f3dda6

metal : skip the empty half of the mul_mm_id token tile (#28301)

masterFoad committed 12 days ago

Verified 5bda51bf

cmake : add PCH and unity build to improve build times (#28091)

danbev committed 12 days ago

Verified 3bcfeb70

common : fix typo in speculative.cpp comment [no ci] (#28750)

danbev committed 12 days ago

Verified 1dfe94e0

metal : single-source fusion table + fusion debug rework (#28164)

ggerganov committed 12 days ago

Verified a2878d30

metal : fix idle threads in the remaining iq mul_mv kernels for ne00 < 1024 (#28692)

masterFoad committed 12 days ago

Verified aac81023

model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (#28630)

LoganChu committed 12 days ago

Verified 5cdd3d1d

server: fix speculation after an image (#28715)

jesdga95 committed 12 days ago

Verified b0dcb819

CUDA/HIP: Flash Attention tuning (gfx1201) (#28102)

pwilkin committed 12 days ago

Verified 16378d93

ci : key cache to sanitizer matrix (#28708)

CISC committed 12 days ago

Verified 451b89ba

vulkan: fix data race and OOB access in argsort(large) (#28705)

jeffbolznv committed 12 days ago

Verified 481c65f0

opencl: add A8 Q4_0 mm binary kernel support (#28268)

shaofeiqi committed 13 days ago

Verified df03399b

vulkan: use CPU writes in ggml_backend_vk_cpy_tensor_async if the context is idle (#28618)

jeffbolznv committed 13 days ago

Verified 28ff0958

vulkan: use add_alloc_dep to enable topk_moe fusion for prefill (#28422)

jeffbolznv committed 13 days ago

Verified 50182a53

vulkan: small M matrix optimizations for qwen (#28457)

jeffbolznv committed 13 days ago

Verified 6788edb4

Newer Older