ggerganov/llama.cpp

Pull Requests Commits

llama-bench : add time-to-first-byte stat

ggerganov committed 1 year ago

Verified bc82fc2e

rpc : backend refactoring (#9912)

rgerganov committed 1 year ago

Verified afd9909a

[SYCL] Add SYCL Backend registry, device and Event Interfaces (#9705)

OuadiElfarouki committed 1 year ago

Verified 87421a23

add amx kernel for gemm (#8998)

mingfeima committed 1 year ago

Verified 60ce97c9

server : add n_indent parameter for line indentation requirement (#9929)

ggerganov committed 1 year ago

Verified 8901755b

llama : rename batch_all to batch (#8881)

danbev committed 1 year ago

Verified 6f55bccb

readme : remove --memory-f32 references (#9925)

ggerganov committed 1 year ago

Verified 17bb9280

llama : change warning to debug log

ggerganov committed 1 year ago

Verified 9f45fc1e

llama : infill sampling handle very long tokens (#9924)

ggerganov committed 1 year ago

Verified 99bd4ac2

readme : update bindings list (#9918)

ShenghaiWang committed 1 year ago

Verified 3752217e

vulkan : add backend registry / device interfaces (#9721)

slaren committed 1 year ago

Verified f010b77a

fix: allocating CPU buffer with size `0` (#9917)

giladgd committed 1 year ago

Verified 21942002

fix: use `vm_allocate` to allocate CPU backend buffer on macOS (#9875)

giladgd committed 1 year ago

Verified 73afe681

llama : suppress conversion from 'size_t' to 'int' (#9046)

danbev committed 1 year ago

Verified 9e041024

llava : fix typo in error message [no ci] (#9884)

danbev committed 1 year ago

Verified dbf18e4d

grammar : fix JSON Schema for string regex with top-level alt. (#9903)

jemc committed 1 year ago

Verified 66c2c930

llama : add tensor name for "result_norm" (#9907)

MollySophia committed 1 year ago

Verified 10433e8b

server : fix the disappearance of the end of the text (#9867)

z80maniac committed 1 year ago

Verified 1f66b699

ggerganov committed 1 year ago

Verified 0e41b300

ggml-alloc : remove buffer_id from leaf_alloc (ggml/987)

danbev committed 1 year ago

Verified cd60b88b

[CANN] Fix cann compilation error (#9891)

leo-pony committed 1 year ago

Verified becfd387

llama : add infill sampler (#9896)

ggerganov committed 1 year ago

Verified 755a9b2b

server : improve infill context reuse (#9894)

ggerganov committed 1 year ago

Verified 223c25a7

sampling : add XTC sampler (#9742)

MaggotHATE committed 1 year ago

Verified fbc98b74

server : update preact (#9895)

ggerganov committed 1 year ago

Verified dcdd5353

readme : update bindings list (#9889)

srgtuszy committed 1 year ago

Verified 4c42f93b

server : handle "logprobs" field with false value (#9871)

VoidIsVoid committed 1 year ago

Verified a89f75e1

Vectorize load instructions in dmmv f16 CUDA kernel (#9816)

agray3 committed 1 year ago

Verified 13dca2a5

server : accept extra_context for the infill endpoint (#9874)

ggerganov committed 1 year ago

Verified d4c19c0f

server : reuse cached context chunks (#9866)

ggerganov committed 1 year ago

Verified c7181bd2

Older