ggerganov/llama.cpp

Pull Requests Commits

llama : make llm_tokenizer more private

ggerganov committed 1 year ago

Verified 6e873e56

refactor tokenizer

kylo5aby committed 1 year ago

d949c584

perplexity : do not escape input data by default (#9548)

CISC committed 1 year ago

Verified 722ec1eb

server : clean-up completed tasks from waiting list (#9531)

ggerganov committed 1 year ago

Verified 6026da52

imatrix : disable prompt escape by default (#9543)

CISC committed 1 year ago

Verified eca0fab4

ggml : fix n_threads_cur initialization with one thread (#9538)

slaren committed 1 year ago

Verified 64c6af31

scripts : verify py deps at the start of compare (#9520)

ggerganov committed 1 year ago

Verified 0d2f22e4

llama : use reserve/emplace_back in sampler_sample (#9534)

danbev committed 1 year ago

Verified 6443ddd9

server : match OAI structured output response (#9527)

VJHack committed 1 year ago

Verified 8a308354

server : fix OpenSSL build (remove obsolete `LOG_INFO`) (#9529)

EZForever committed 1 year ago

Verified f799155a

[SYCL]set context default value to avoid memory issue, update guide (#9476)

NeoZhangJianyu committed 1 year ago

Verified faf67b3d

llama-bench: correct argument parsing error message (#9524)

Xarbirus committed 1 year ago

Verified 7be099fa

arg : add env variable for parallel (#9513)

bertwagner committed 1 year ago

Verified 8b836ae7

llama : fix n_vocab init for 'no_vocab' case (#9511)

Xarbirus committed 1 year ago

Verified 8344ef58

threadpool : skip polling for unused threads (#9461)

max-krasnyansky committed 1 year ago

Verified 02266138

unicode : add <algorithm> (#9508)

ykhrustalev committed 1 year ago

Verified 503147a9

llama : support IBM Granite architecture (#9412)

gabe-l-hart committed 1 year ago

Verified 0d2ec438

llama : add llama_n_head() (#9512)

Xarbirus committed 1 year ago

Verified 37f3a381

ggml : move common CPU backend impl to new header (#9509)

slaren committed 1 year ago

Verified 23e0d70b

llama : rename n_embed to n_embd in rwkv6_time_mix (#9504)

danbev committed 1 year ago

Verified acb2c32c

ggml : link MATH_LIBRARY not by its full path (#9339)

Xarbirus committed 1 year ago

Verified a6a3a5c5

convert : identify missing model files (#9397)

compilade committed 1 year ago

Verified d54c21df

cmake : do not hide GGML options + rename option (#9465)

ggerganov committed 1 year ago

Verified 19514d63

ggml : IQ4_NL sgemm + Q4_0 AVX optimization (#9422)

netrunnereve committed 1 year ago

Verified 5c3d0f18

llama : support OLMoE (#9462)

2015aroras committed 1 year ago

Verified 0aadac10

llama : support MiniCPM3 (#9322)

CarryFun committed 1 year ago

Verified 95ca8516

main : option to disable context shift (#9484)

VJHack committed 1 year ago

Verified 441b72b9

metal : handle zero-sized allocs (#9466)

ggerganov committed 1 year ago

Verified c4965a64

flake.lock: Update (#9488)

ggerganov committed 1 year ago

Verified 90a2fff0

common : reimplement logging (#9418)

ggerganov committed 1 year ago

Verified 6262d13e

Older