ggerganov/llama.cpp

Pull Requests Commits

[SYCL] fix set main gpu crash (#6339)

NeoZhangJianyu committed 1 year ago

Verified 25f4a613

server: continuous performance monitoring and PR comment (#6283)

phymbert committed 1 year ago

Verified a016026a

nix: ci: dont test cuda and rocm (for now)

SomeoneSerge committed 1 year ago

53c7ec53

ggml : fix bounds checking of zero size views (#6347)

slaren committed 1 year ago

Verified e5b89a44

make : whitespace

ggerganov committed 1 year ago

Verified 3a034597

embedding : show full embedding for single prompt (#6342)

howlger committed 1 year ago

Verified 1e13987f

[SYCL] Fix batched impl for NVidia GPU (#6164)

AidanBeltonS committed 1 year ago

Verified e82f9e2b

Make IQ1_M work for QK_K = 64 (#6327)

ikawrakow committed 1 year ago

Verified cbc83436

common : change --no-penalize-nl to --penalize-nl (#6334)

CISC committed 1 year ago

Verified e562b971

llama2c : open file as binary (#6332)

ggerganov committed 1 year ago

Verified 2ab4f00d

readme : add php api bindings (#6326)

mcharytoniuk committed 1 year ago

Verified 1740d6dd

server: public: use relative routes for static files (#6325)

EZForever committed 1 year ago

Verified 0642b22c

[SYCL] fix no file in win rel (#6314)

NeoZhangJianyu committed 1 year ago

Verified a4f569e8

wpm : portable unicode tolower (#6305)

cebtenzzre committed 1 year ago

Verified 32c8486e

llama : greatly reduce output buffer memory usage (#6122)

compilade committed 1 year ago

Verified 557410b8

IQ1_M: 1.75 bpw quantization (#6302)

ikawrakow committed 1 year ago

Verified 55c1b2a3

convert-hf : fix exception in sentencepiece with added tokens (#6320)

pcuenca committed 1 year ago

Verified e097633f

quantize : be able to override metadata by key (#6321)

ikawrakow committed 1 year ago

Verified d25b1c31

embedding : adjust `n_ubatch` value (#6296)

mscheong01 committed 1 year ago

Verified deb72401

server : add `n_discard` parameter (#6300)

kaetemi committed 1 year ago

Verified 3d032ece

nix: make `xcrun` visible in Nix sandbox for precompiling Metal shaders (#6118)

josephst committed 1 year ago

Verified e190f1fc

cuda : rename build flag to LLAMA_CUDA (#6299)

slaren committed 1 year ago

Verified 28034596

nix: fix blas support (#6281)

ck3d committed 1 year ago

Verified b06c16ef

tests : include IQ2_XXS and IQ2_XS in test-quantize-fns (#6303)

ikawrakow committed 1 year ago

Verified 1f2fd4e7

flake.lock: Update (#6266)

ggerganov committed 1 year ago

Verified 43139cc5

cuda : fix LLAMA_CUDA_F16 build (#6298)

slaren committed 1 year ago

Verified 2f34b865

cuda : refactor into multiple files (#6269)

slaren committed 1 year ago

Verified ae1f211c

Server: clean up OAI params parsing function (#6284)

ngxson committed 1 year ago

Verified ad3a0505

[SYCL] fix SYCL backend build on windows is break by LOG() error (#6290)

NeoZhangJianyu committed 1 year ago

Verified 95ad616c

examples : add "retrieval" (#6193)

mscheong01 committed 1 year ago

Verified 64e7b47c

Newer Older