ggml-org/llama.cpp

Pull Requests Commits
server: do not remove whitespace at the start of a completion chunk (#7830)
mgroeber9110 committed 1 year ago
Verified 3e2ee443
CUDA: revise q8_1 data layout for mul_mat_q (#7824)
JohannesGaessler committed 1 year ago
Verified 42b53d19
convert-hf : set the model name based on cli arg, if present (#7693)
sasha0552 committed 1 year ago
Verified 2decf57b
convert-hf : match model part name prefix and suffix (#7687)
compilade committed 1 year ago
Verified 5795b941
gguf-py : decouple adding metadata from writing in GGUFWriter (#7827)
compilade committed 1 year ago
Verified ed9f2521
Revert "[SYCL] Update rpc-server.cpp to include SYCL backend (#7682)" (#7808)
slaren committed 1 year ago
Verified fe1e3917
url: save -mu downloads to new cache location (#7826)
ochafik committed 1 year ago
Verified d4d915d3
server : smart slot selection using Longest Common Prefix (#7728)
sasha0552 committed 1 year ago
Verified 7a16ce7d
vulkan : reuse parent extra for views (#7806)
slaren committed 1 year ago
Verified da799b41
gguf-split : change binary multi-byte units to decimal (#7803)
christianazinn committed 1 year ago
Verified c00fad71
cmake : fix BUILD_SHARED_LIBS=ON build (#7784)
intelmatt committed 1 year ago
Verified 27615f5a
server: update cache_prompt documentation [no ci] (#7745)
JohannesGaessler committed 1 year ago
Verified 7027b27d
server : do not get prompt in infill mode (#7286)
woodx9 committed 1 year ago
Verified a5cabd76
[SYCL] fix softmax r2r result wrong issue (#7811)
pengxin99 committed 1 year ago
Verified d5c938cd
check for nans in imatrix and quantize (#7807)
slaren committed 1 year ago
Verified c9ee7118
server : fix --threads-http arg (#7801)
ggerganov committed 1 year ago
Verified ee459f40
imatrix : migrate to gpt_params (#7771)
ggerganov committed 1 year ago
Verified f83351f9
Added support for . (any character) token in grammar engine. (#6467)
HanClinto committed 1 year ago
Verified ad675e1c
README minor fixes (#7798) [no ci]
mattchediak committed 1 year ago
Verified a143c043
grammars: x{min,max} repetition operator (#6640)
ochafik committed 1 year ago
Verified 55b2d084
llama : add jina v2 base code (#7596)
JoanFM committed 1 year ago
Verified f5d7b268
docker : build only main and server in their images (#7782)
slaren committed 1 year ago
Verified 2d08b7fb
docker : add openmp lib (#7780)
slaren committed 1 year ago
Verified d67caea0
Fix encoding in python scripts (#7733)
Galunid committed 1 year ago
Verified 7672adee
CUDA: refactor mmq, dmmv, mmvq (#7716)
JohannesGaessler committed 1 year ago
Verified 7d1a378b
ggml : refactor rope norm/neox (#7634)
ggerganov committed 1 year ago
Verified 2b338967
readme : remove -ins (#7759)
arch-btw committed 1 year ago
Verified 9973e81c
Fix per token atrributes bits (#7749)
jaime-m-p committed 1 year ago
Verified c90dbe02
Allow number of nodes in CUDA graph to change (#7738)
agray3 committed 1 year ago
Verified b90dc566
common : refactor cli arg parsing (#7675)
ggerganov committed 1 year ago
Verified 1442677f
Terms Of Use Privacy Policy Refund Policy Impressum