ggml-org/llama.cpp

Pull Requests Commits

common : restore --n-gpu-layers (#9371)

slaren committed 1 year ago

Verified a249843d

llama : refactor samplers internal implementation (#9370)

slaren committed 1 year ago

Verified 19f4a7b2

[SYCL] add check malloc result on device (#9346)

NeoZhangJianyu committed 1 year ago

Verified 2a358fb0

llama : sanitize tokens in the upper bound (#9359)

slaren committed 1 year ago

Verified eae59718

imatrix : fix arg parser for imatrix (#9366)

ngxson committed 1 year ago

Verified 00b02bb2

metal : update support condition for im2col + fix warning (#0)

ggerganov committed 1 year ago

a8768614

ggerganov committed 1 year ago

385decbd

scripts : option to increase git patch context

ggerganov committed 1 year ago

60a3107c

vulkan: add dryrun support to sin and cos ops (ggml/947)

smeso committed 1 year ago

406c1a32

vulkan: correctly report support for OP_CONT (ggml/946)

smeso committed 1 year ago

9cb92608

tests: add gradient tests for all backends (ggml/932)

JohannesGaessler committed 1 year ago

202084d3

ggml: fix ggml_graph_cpy undefined behavior (ggml/943)

JohannesGaessler committed 1 year ago

dbbebcab

cann : fix doxy (ggml/0)

ggerganov committed 1 year ago

ba1cf846

cann : add Ascend NPU support (whisper/2336)

MengqingCao committed 1 year ago

d2d3200b

cuda : mark BF16 CONT as unsupported

ggerganov committed 1 year ago

51d964a4

ggml : fix cont with transposed tensors when one dimension is 1 (ggml/934)

smeso committed 1 year ago

efe6a83e

llama : set attrs of mislabelled EOT/EOM tokens (#9348)

bakkot committed 1 year ago

Verified fbb7fcff

llama.android : fix build (#9350)

ggerganov committed 1 year ago

Verified a5b5d9a1

llama : fix empty ring buffer push (#9358)

ggerganov committed 1 year ago

Verified f12295b8

llama : sanitize invalid tokens (#9357)

ggerganov committed 1 year ago

Verified faf69d42

llamafile : disable sgemm for batch-size 1 (#9330)

netrunnereve committed 1 year ago

Verified e536426d

common : refactor arg parser (#9308)

ngxson committed 1 year ago

Verified 1b9ae518

ggml : always check bounds on get_rows operations (#9354)

slaren committed 1 year ago

Verified e32d0816

llama : refactor sampling v2 (#9294)

ggerganov committed 1 year ago

Verified df270ef7

ggml : fix missing `cpu_set_t` on emscripten (#9336)

ngxson committed 1 year ago

Verified 947538ac

ci : disable rocm image creation (#9340)

slaren committed 1 year ago

Verified 6c89eb0b

server : simplify state machine for slot (#9283)

ngxson committed 1 year ago

Verified 9b2c24c0

llama-bench : log benchmark progress (#9287)

akx committed 1 year ago

Verified 134bc38e

batched-bench : add `--output-format jsonl` option (#9293)

akx committed 1 year ago

Verified 815b1fb2

ggml : fix build break for the vulkan-debug (#9265)

cyzero-kim committed 1 year ago

Verified 409dc4f8

Newer Older