ggml-org/llama.cpp

Pull Requests Commits

Merge branch 'master' into xsn/vllm_d3

ngxson committed 6 days ago

fde44572

model: support vllm decision 2 model (#30378)

ngxson committed 6 days ago

Verified 097cf33d

ngxson committed 6 days ago

50bdee49

tests : link each test against only the libraries it uses (#30299)

ggerganov committed 6 days ago

Verified ccdbe290

metal : fix mul_mat_id with duplicate ids (#30373)

ggerganov committed 6 days ago

Verified 073b7403

examples : fix draft sampling and rejection handling (#30095)

danbev committed 6 days ago

Verified 77757a34

stricter validation

ngxson committed 6 days ago

0f22bf98

clarify naming rule

ngxson committed 6 days ago

08d8bd94

Merge branch 'master' into xsn/vllm_d2

ngxson committed 6 days ago

d5d32e56

ngxson committed 6 days ago

f1d57264

ngxson committed 6 days ago

5e22c48f

llama : report compute graph reallocations during inference (#30329)

ggerganov committed 6 days ago

Verified 972b5fcc

ui: fix text attachment preview overflow (#29898)

shamnadxyz committed 7 days ago

Verified 2f160ba5

sycl: guard DMMV reads at row tails (#29338)

newjordan committed 7 days ago

Verified f9a95aeb

vulkan: use ternary expressions to avoid switch lowering for CM2 quant block size (#30164)

SG-Amadeus committed 7 days ago

Verified 08ffba21

ggml: Change default visibility of symbols to hidden (#30014)

ckastner committed 7 days ago

Verified a05e58c9

vulkan: fix buffer logging on 32-bit platforms after source split (#30326)

miyanyan committed 7 days ago

Verified b2f036c0

hexagon: optimize q2_k bpw and activation (#30035)

jhen0409 committed 7 days ago

Verified e937b17a

hexagon: add IM2COL_3D (#30305)

kurquhar committed 7 days ago

Verified b13a93a3

opencl: improve fa, allow dk512 for gemma-4, improve dk64 (#30266)

lhez committed 7 days ago

Verified f2cc7282

opencl: fix image limit for q4_k dense bin kernels, q4_0 bcast and rms_norm (#30310)

lhez committed 7 days ago

Verified c83f3058

rpc : turn GGML_RPC_DEBUG into a verbosity level and add logs (#29544)

ggerganov committed 7 days ago

Verified 5c8854fd

model : support for Prism Bonsai 2 27B (#29600)

bri-prism committed 7 days ago

Verified a9d27ac6

cpu: fix AVX2 CPUs not using F16C when available (#30270)

xinitrcn1 committed 7 days ago

Verified 1cf77677

vulkan: handle mul_mat_id duplicates in the prepass rather than looping (#29998)

jeffbolznv committed 7 days ago

Verified 966baae7

server: add component tests (#30312)

ngxson committed 7 days ago

Verified 62a6f74b

server: leave a busy slot untouched when a request pins it (#30295)

ServeurpersoCom committed 8 days ago

Verified 23b0202a

model : support MiniCPM-V 4.7 (#29416)

tc-mb committed 8 days ago

Verified 69f201a2

cmake(s390x): disable z17 target for unsupported compilers (#30297)

taronaeo committed 8 days ago

Verified abee0c84

args: add LLAMA_ARG_SLOT_SAVE_PATH env for --slot-save-path (#30272)

kucharskim committed 8 days ago

Verified aa94f208

Older