ggerganov/llama.cpp

Pull Requests Commits

cuda : fix build

ggerganov committed 1 year ago

Verified 6be02b59

Merge branch 'master' into gg/flash-attn

ggerganov committed 1 year ago

Verified 013721df

Make IQ1_M work for QK_K = 64 (#6327)

ikawrakow committed 1 year ago

Verified cbc83436

common : change --no-penalize-nl to --penalize-nl (#6334)

CISC committed 1 year ago

Verified e562b971

llama2c : open file as binary (#6332)

ggerganov committed 1 year ago

Verified 2ab4f00d

readme : add php api bindings (#6326)

mcharytoniuk committed 1 year ago

Verified 1740d6dd

server: public: use relative routes for static files (#6325)

EZForever committed 1 year ago

Verified 0642b22c

[SYCL] fix no file in win rel (#6314)

NeoZhangJianyu committed 1 year ago

Verified a4f569e8

wpm : portable unicode tolower (#6305)

cebtenzzre committed 1 year ago

Verified 32c8486e

llama : greatly reduce output buffer memory usage (#6122)

compilade committed 1 year ago

Verified 557410b8

IQ1_M: 1.75 bpw quantization (#6302)

ikawrakow committed 1 year ago

Verified 55c1b2a3

convert-hf : fix exception in sentencepiece with added tokens (#6320)

pcuenca committed 1 year ago

Verified e097633f

quantize : be able to override metadata by key (#6321)

ikawrakow committed 1 year ago

Verified d25b1c31

embedding : adjust `n_ubatch` value (#6296)

mscheong01 committed 1 year ago

Verified deb72401

server : add `n_discard` parameter (#6300)

kaetemi committed 1 year ago

Verified 3d032ece

nix: make `xcrun` visible in Nix sandbox for precompiling Metal shaders (#6118)

josephst committed 1 year ago

Verified e190f1fc

cuda : rename build flag to LLAMA_CUDA (#6299)

slaren committed 1 year ago

Verified 28034596

nix: fix blas support (#6281)

ck3d committed 1 year ago

Verified b06c16ef

tests : include IQ2_XXS and IQ2_XS in test-quantize-fns (#6303)

ikawrakow committed 1 year ago

Verified 1f2fd4e7

flake.lock: Update (#6266)

ggerganov committed 1 year ago

Verified 43139cc5

cuda : fix LLAMA_CUDA_F16 build (#6298)

slaren committed 1 year ago

Verified 2f34b865

cuda : refactor into multiple files (#6269)

slaren committed 1 year ago

Verified ae1f211c

Server: clean up OAI params parsing function (#6284)

ngxson committed 1 year ago

Verified ad3a0505

[SYCL] fix SYCL backend build on windows is break by LOG() error (#6290)

NeoZhangJianyu committed 1 year ago

Verified 95ad616c

examples : add "retrieval" (#6193)

mscheong01 committed 1 year ago

Verified 64e7b47c

ggml : support AVX512VNNI (#6280)

jart committed 1 year ago

Verified 7733f0c7

Fix heap corruption from wmode out-of-bound writes on windows (#6272)

TheFlipbook committed 1 year ago

Verified a32b77c4

imatrix : fix wname for mul_mat_id ops (#6271)

ggerganov committed 1 year ago

Verified a0e584de

Fixed lookup compilation issues on Windows (#6273)

JohannesGaessler committed 1 year ago

Verified 7aed0ffe

tests : add hs=256

ggerganov committed 1 year ago

Verified e425810b

Older