ggml-org/llama.cpp

Pull Requests Commits

ggerganov committed 1 year ago

Verified bb5f8199

examples : adapt to ggml.h changes (ggml/0)

ggerganov committed 1 year ago

Verified c0389316

llama : keep track of all EOG tokens in the vocab (#9609)

ggerganov committed 1 year ago

Verified 31ac5834

log : add CONT level for continuing previous log entry (#9610)

ggerganov committed 1 year ago

Verified cea1486e

server : add newline after chat example (#9616)

StrangeBytesDev committed 1 year ago

Verified 0aa15011

sampling : avoid expensive softmax during greedy sampling (#9605)

ggerganov committed 1 year ago

Verified b0f27361

threads: fix msvc build without openmp (#9615)

max-krasnyansky committed 1 year ago

Verified c087b6f1

cuda: add q8_0->f32 cpy operation (#9571)

Nekotekina committed 1 year ago

Verified 116efee0

server : add --no-context-shift option (#9607)

ngxson committed 1 year ago

Verified 0b3bf966

threads: improve ggml_barrier scaling with large number of threads (#9598)

max-krasnyansky committed 1 year ago

Verified f0c7b5ed

readme : add programmable prompt engine language CLI (#9599)

snowyu committed 1 year ago

Verified 1d48e98e

flake.lock: Update (#9586)

ggerganov committed 1 year ago

Verified f3979df7

ggml : AVX512 gemm for Q4_0_8_8 (#9532)

Srihari-mcw committed 1 year ago

Verified 1e7b9299

perplexity : remove extra new lines after chunks (#9596)

ggerganov committed 1 year ago

Verified 37f8c7b4

metal : use F32 prec for K*Q in vec FA (#9595)

ggerganov committed 1 year ago

Verified bf9c1013

Revert "[SYCL] fallback mmvq (#9088)" (#9579)

Akarshan Biswas committed 1 year ago

Verified e62e9789

musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (#9526)

yeahdongcn committed 1 year ago

Verified c35e586e

Fix merge error in #9454 (#9589)

MollySophia committed 1 year ago

Verified 912c331d

CUDA: enable Gemma FA for HIP/Pascal (#9581)

JohannesGaessler committed 1 year ago

Verified a5b57b08

llama: remove redundant loop when constructing ubatch (#9574)

shankarg87 committed 1 year ago

Verified ecd5d6b6

RWKV v6: RWKV_WKV op CUDA implementation (#9454)

MollySophia committed 1 year ago

Verified 2a63caaa

ggml-alloc : fix list of allocated tensors with GGML_ALLOCATOR_DEBUG (#9573)

slaren committed 1 year ago

Verified d09770ca

Update CUDA graph on scale change plus clear nodes/params (#9550)

agray3 committed 1 year ago

Verified 41f47787

CI: Provide prebuilt windows binary for hip (#9467)

no1wudi committed 1 year ago

Verified e948a7da

quantize : improve type name parsing (#9570)

slaren committed 1 year ago

Verified 63351143

ggml : fix builds (#0)

ggerganov committed 1 year ago

d13edb17

ggml : fix trailing whitespace (#0)

ggerganov committed 1 year ago

27609c49

ggerganov committed 1 year ago

43015353

ggml/examples: add backend support for numerical optimization (ggml/949)

JohannesGaessler committed 1 year ago

424c5d00

examples : add null threadpool args where needed (ggml/0)

ggerganov committed 1 year ago

a6809c6a

Newer Older