ggerganov/llama.cpp

Pull Requests Commits

sampling : fix off-by-one in tail-free sampling

ggerganov committed 1 year ago

Verified 114ab634

perplexity : remove extra new lines after chunks (#9596)

ggerganov committed 1 year ago

Verified 37f8c7b4

metal : use F32 prec for K*Q in vec FA (#9595)

ggerganov committed 1 year ago

Verified bf9c1013

Revert "[SYCL] fallback mmvq (#9088)" (#9579)

Akarshan Biswas committed 1 year ago

Verified e62e9789

musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (#9526)

yeahdongcn committed 1 year ago

Verified c35e586e

Fix merge error in #9454 (#9589)

MollySophia committed 1 year ago

Verified 912c331d

CUDA: enable Gemma FA for HIP/Pascal (#9581)

JohannesGaessler committed 1 year ago

Verified a5b57b08

llama: remove redundant loop when constructing ubatch (#9574)

shankarg87 committed 1 year ago

Verified ecd5d6b6

RWKV v6: RWKV_WKV op CUDA implementation (#9454)

MollySophia committed 1 year ago

Verified 2a63caaa

ggml-alloc : fix list of allocated tensors with GGML_ALLOCATOR_DEBUG (#9573)

slaren committed 1 year ago

Verified d09770ca

Update CUDA graph on scale change plus clear nodes/params (#9550)

agray3 committed 1 year ago

Verified 41f47787

CI: Provide prebuilt windows binary for hip (#9467)

no1wudi committed 1 year ago

Verified e948a7da

quantize : improve type name parsing (#9570)

slaren committed 1 year ago

Verified 63351143

ggml : fix builds (#0)

ggerganov committed 1 year ago

d13edb17

ggml : fix trailing whitespace (#0)

ggerganov committed 1 year ago

27609c49

ggerganov committed 1 year ago

43015353

ggml/examples: add backend support for numerical optimization (ggml/949)

JohannesGaessler committed 1 year ago

424c5d00

examples : add null threadpool args where needed (ggml/0)

ggerganov committed 1 year ago

a6809c6a

CUDA: fix sum.cu compilation for CUDA < 11.7 (#9562)

JohannesGaessler committed 1 year ago

Verified 5cb12f68

examples : flush log upon ctrl+c (#9559)

ggerganov committed 1 year ago

Verified d39e2674

perplexity : do not escape input data by default (#9548)

CISC committed 1 year ago

Verified 722ec1eb

server : clean-up completed tasks from waiting list (#9531)

ggerganov committed 1 year ago

Verified 6026da52

imatrix : disable prompt escape by default (#9543)

CISC committed 1 year ago

Verified eca0fab4

ggml : fix n_threads_cur initialization with one thread (#9538)

slaren committed 1 year ago

Verified 64c6af31

scripts : verify py deps at the start of compare (#9520)

ggerganov committed 1 year ago

Verified 0d2f22e4

llama : use reserve/emplace_back in sampler_sample (#9534)

danbev committed 1 year ago

Verified 6443ddd9

server : match OAI structured output response (#9527)

VJHack committed 1 year ago

Verified 8a308354

server : fix OpenSSL build (remove obsolete `LOG_INFO`) (#9529)

EZForever committed 1 year ago

Verified f799155a

[SYCL]set context default value to avoid memory issue, update guide (#9476)

NeoZhangJianyu committed 1 year ago

Verified faf67b3d

llama-bench: correct argument parsing error message (#9524)

Xarbirus committed 1 year ago

Verified 7be099fa

Older