ngxson/llama.cpp

Pull Requests Commits
Merge branch 'master' into xsn/slot_state_machine
ngxson committed 1 year ago
e0fdcda9
Update examples/server/server.cpp
ngxson committed 1 year ago
Verified 38b14cd3
server : fix missing lock (#9334)
ngxson committed 1 year ago
Verified 4a1411b4
pop_deferred_task: also notify
ngxson committed 1 year ago
dd7e853b
missing lock
ngxson committed 1 year ago
e9313f2e
fix deque ?
ngxson committed 1 year ago
2ab3da68
Improve Vulkan shader build system (#9239)
mtavenrath committed 1 year ago
Verified 8ebe8dde
ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)
compilade committed 1 year ago
Verified 9bc6db28
Update build.yml (#9184)
awatuna committed 1 year ago
Verified 32b2ec88
CMake fix: host for msvc compiler can only be x86 or x64 (#8624)
Xarbirus committed 1 year ago
Verified 1031771f
cuda : fix defrag with quantized KV (#9319)
slaren committed 1 year ago
Verified 4db04784
llama-bench : fix NUL terminators in CPU name (#9313)
slaren committed 1 year ago
Verified bdf314f3
ggml : AVX2 support for Q4_0_8_8 (#8713)
Srihari-mcw committed 1 year ago
Verified 581c3051
[SYCL] Fix DMMV dequantization (#9279)
OuadiElfarouki committed 1 year ago
Verified 5910ea94
Fix broken links in docker.md (#9306)
carlory committed 1 year ago
Verified c8671ae2
rpc : make RPC servers come first in the device list (#9296)
rgerganov committed 1 year ago
Verified 82e3b03c
readme : rename result_format to response_format (#9300)
iscy committed 1 year ago
Verified 9379d3cc
flake.lock: Update (#9261)
ggerganov committed 1 year ago
Verified 7605ae7d
llama-bench : add JSONL (NDJSON) output mode (#9288)
akx committed 1 year ago
Verified 8962422b
maybe fix AddressSanitizer?
ngxson committed 1 year ago
040fddee
add test
ngxson committed 1 year ago
852f6548
Merge branch 'master' into xsn/slot_state_machine
ngxson committed 1 year ago
ba0065fc
fix test step
ngxson committed 1 year ago
e8e3e725
metrics : add n_busy_slots_per_decode
ngxson committed 1 year ago
69b398ce
fix passkey test
ngxson committed 1 year ago
fbebf650
add missing notify_one
ngxson committed 1 year ago
d3fedaa6
pop_deferred_task
ngxson committed 1 year ago
ec882cc1
readme : refactor API section + remove old hot topics
ggerganov committed 1 year ago
Verified b69a480a
add SLOT_STATE_DONE_PROMPT
ngxson committed 1 year ago
446d57d7
server : simplify state machine for slot
ngxson committed 1 year ago
2c81cde4
Terms Of Use Privacy Policy Refund Policy Impressum