ggerganov/llama.cpp

Pull Requests Commits

slaren committed 263 days ago

c3e2bb6d

server : simplify state machine for slot (#9283)

ngxson committed 264 days ago

Verified 9b2c24c0

llama-bench : log benchmark progress (#9287)

akx committed 264 days ago

Verified 134bc38e

batched-bench : add `--output-format jsonl` option (#9293)

akx committed 264 days ago

Verified 815b1fb2

ggml : fix build break for the vulkan-debug (#9265)

cyzero-kim committed 264 days ago

Verified 409dc4f8

server : fix missing lock (#9334)

ngxson committed 264 days ago

Verified 4a1411b4

Improve Vulkan shader build system (#9239)

mtavenrath committed 264 days ago

Verified 8ebe8dde

ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)

compilade committed 264 days ago

Verified 9bc6db28

Update build.yml (#9184)

awatuna committed 265 days ago

Verified 32b2ec88

CMake fix: host for msvc compiler can only be x86 or x64 (#8624)

Xarbirus committed 265 days ago

Verified 1031771f

cuda : fix defrag with quantized KV (#9319)

slaren committed 265 days ago

Verified 4db04784

llama-bench : fix NUL terminators in CPU name (#9313)

slaren committed 265 days ago

Verified bdf314f3

ggml : AVX2 support for Q4_0_8_8 (#8713)

Srihari-mcw committed 266 days ago

Verified 581c3051

[SYCL] Fix DMMV dequantization (#9279)

OuadiElfarouki committed 266 days ago

Verified 5910ea94

Fix broken links in docker.md (#9306)

carlory committed 266 days ago

Verified c8671ae2

rpc : make RPC servers come first in the device list (#9296)

rgerganov committed 266 days ago

Verified 82e3b03c

readme : rename result_format to response_format (#9300)

iscy committed 266 days ago

Verified 9379d3cc

flake.lock: Update (#9261)

ggerganov committed 267 days ago

Verified 7605ae7d

llama-bench : add JSONL (NDJSON) output mode (#9288)

akx committed 267 days ago

Verified 8962422b

readme : refactor API section + remove old hot topics

ggerganov committed 267 days ago

Verified b69a480a

server : test script : add timeout for all requests (#9282)

ngxson committed 268 days ago

Verified 48baa61e

src: make tail invalid when kv cell is intersection for mamba (#9249)

kylo5aby committed 268 days ago

Verified f1485161

docker : fix missing binaries in full-cuda image (#9278)

slaren committed 268 days ago

Verified 048de848

ggml : add pthread includes on FreeBSD (#9258)

yurivict committed 268 days ago

Verified f771d064

server : refactor multitask handling (#9274)

ngxson committed 268 days ago

Verified 6e7d133a

llama-cli : remove duplicated log message (#9275)

nbcsm committed 268 days ago

Verified b60074f1

build(nix): Package gguf-py (#5664)

ditsuke committed 268 days ago

Verified 9c1ba557

llama : minor style

ggerganov committed 268 days ago

Verified c6d4cb46

llama : support RWKV v6 models (#8980)

MollySophia committed 269 days ago

Verified 8f1d81a0

nix: fix CUDA build - replace deprecated autoAddOpenGLRunpathHook

enolan committed 270 days ago

a47667cf

Older