ggml-org/llama.cpp

Pull Requests Commits

ggerganov committed 7 days ago

Verified b8eb3b35

Readd `cub::DeviceScan::InclusiveSum`-based CumSum

ORippler committed 8 days ago

e6525661

Merge branch 'master' into gpu-sampling

ORippler committed 8 days ago

76689995

Add perf-tests for CUMSUM

ORippler committed 8 days ago

dd11f6eb

sampling : fix candidates logic

ggerganov committed 8 days ago

Verified cf74b1a8

fix: prevent segfault in tokenizer on highly repetitive input (#17786)

ServeurpersoCom committed 8 days ago

Verified 1be97831

ci : fix winget workflow (#17790)

angt committed 8 days ago

Verified a6cfc212

Q4/Q8 Tiled Gemm Optimization. (#16999)

shalinib-ibm committed 8 days ago

Verified 3a0d1053

Add pwilkin to CODEOWNERS for chat files (#17789)

pwilkin committed 8 days ago

Verified 66489896

CUDA: fix FA VKQ accumulator overflow (#17746)

JohannesGaessler committed 8 days ago

Verified e95d0bc8

HIP: enable WMMA-MMQ INT kernels for RDNA 3 (#17576)

jiachengjason committed 8 days ago

Verified 668ed765

ci : transform release binary root dir in tar to llama-bXXXX (#17773)

CISC committed 9 days ago

Verified 03d9a77b

docs : update ops.md (Metal, BLAS) (#17768)

gabe-l-hart committed 9 days ago

Verified 3143a755

Add support for CUMSUM and TRI for CUDA. (#17584)

pwilkin committed 9 days ago

Verified 96fe9bad

sampling : fix outputs and device checks

ggerganov committed 9 days ago

Verified 7864074f

metal: TRI, FILL, EXPM1, SOFTPLUS (#16623)

gabe-l-hart committed 9 days ago

Verified bde188d6

cont : keep backend sampling disabled for now

ggerganov committed 9 days ago

Verified abc19635

server: strip content-length header on proxy (#17734)

ngxson committed 9 days ago

Verified 9d022996

sampling : check backend support during init

ggerganov committed 9 days ago

Verified 6958d413

server: move msg diffs tracking to HTTP thread (#17740)

ngxson committed 9 days ago

Verified c4c10bfb

examples : add missing code block end marker [no ci] (#17756)

danbev committed 9 days ago

Verified 817d743c

common : skip model validation when --help is requested (#17755)

danbev committed 9 days ago

Verified bd4ef134

sampling : remove redundant calls to ggml_build_forward_expand

ggerganov committed 9 days ago

Verified 1bde7078

sampling : simplify temp sampling

ggerganov committed 9 days ago

Verified fce571ee

ggml-cpu : remove asserts always evaluating to false (#17728)

Alcpz committed 9 days ago

Verified 87a2084c

convert: use existing local chat_template if mistral-format model has one. (#17749)

SmartestWashingMachine committed 9 days ago

Verified 3659aa28

cmake : simplify build info detection using standard variables (#17423)

angt committed 9 days ago

Verified 2a73f81f

ci : disable ggml-ci-x64-amd-* (#17753)

CISC committed 9 days ago

Verified 7dba049b

common: use native MultiByteToWideChar (#17738)

angt committed 9 days ago

Verified 83c11715

sampling : fix backend temp sampling to use logits masking

danbev committed 9 days ago

Verified ac9e1647

Older