ggerganov/llama.cpp

Pull Requests Commits

contrib : stale PRs

ggerganov committed 24 days ago

Verified 31436df5

ggml webgpu: unary op suppport, code refactoring, ops support (#17764)

reeselevine committed 24 days ago

Verified fd57b24c

vulkan: enable mmvq for q2_k on NVIDIA (#17675)

jeffbolznv committed 24 days ago

Verified 6ab0d649

vulkan: set all memory allocations to high priority (#17624)

jeffbolznv committed 24 days ago

Verified 93bb9266

rpc : fix alloc size logic (#17116)

ggerganov committed 24 days ago

Verified 8160b38a

metal : add residency sets keep-alive heartbeat (#17766)

ggerganov committed 24 days ago

Verified c41bde6f

HIP : fix RDNA4 build (#17792)

JohannesGaessler committed 24 days ago

Verified 6016d0bd

fix: prevent segfault in tokenizer on highly repetitive input (#17786)

ServeurpersoCom committed 24 days ago

Verified 1be97831

ci : fix winget workflow (#17790)

angt committed 24 days ago

Verified a6cfc212

Q4/Q8 Tiled Gemm Optimization. (#16999)

shalinib-ibm committed 24 days ago

Verified 3a0d1053

Add pwilkin to CODEOWNERS for chat files (#17789)

pwilkin committed 24 days ago

Verified 66489896

CUDA: fix FA VKQ accumulator overflow (#17746)

JohannesGaessler committed 24 days ago

Verified e95d0bc8

HIP: enable WMMA-MMQ INT kernels for RDNA 3 (#17576)

jiachengjason committed 24 days ago

Verified 668ed765

ci : transform release binary root dir in tar to llama-bXXXX (#17773)

CISC committed 24 days ago

Verified 03d9a77b

docs : update ops.md (Metal, BLAS) (#17768)

gabe-l-hart committed 24 days ago

Verified 3143a755

Add support for CUMSUM and TRI for CUDA. (#17584)

pwilkin committed 25 days ago

Verified 96fe9bad

metal: TRI, FILL, EXPM1, SOFTPLUS (#16623)

gabe-l-hart committed 25 days ago

Verified bde188d6

server: strip content-length header on proxy (#17734)

ngxson committed 25 days ago

Verified 9d022996

server: move msg diffs tracking to HTTP thread (#17740)

ngxson committed 25 days ago

Verified c4c10bfb

examples : add missing code block end marker [no ci] (#17756)

danbev committed 25 days ago

Verified 817d743c

common : skip model validation when --help is requested (#17755)

danbev committed 25 days ago

Verified bd4ef134

ggml-cpu : remove asserts always evaluating to false (#17728)

Alcpz committed 25 days ago

Verified 87a2084c

convert: use existing local chat_template if mistral-format model has one. (#17749)

SmartestWashingMachine committed 25 days ago

Verified 3659aa28

cmake : simplify build info detection using standard variables (#17423)

angt committed 25 days ago

Verified 2a73f81f

ci : disable ggml-ci-x64-amd-* (#17753)

CISC committed 25 days ago

Verified 7dba049b

common: use native MultiByteToWideChar (#17738)

angt committed 25 days ago

Verified 83c11715

metal : use params per pipeline instance (#17739)

ggerganov committed 25 days ago

Verified 0d132485

llama : fix sanity checks during quantization (#17721)

ggerganov committed 25 days ago

Verified a67ef0f4

build : move _WIN32_WINNT definition to headers (#17736)

angt committed 25 days ago

Verified ef75a89f

build: enable parallel builds in msbuild using MTT (#17708)

jeffbolznv committed 25 days ago

Verified d8b5cdc4

Older