ochafik/llama.cpp

Pull Requests Commits
server : detect search query to start webchat (#6554)
Mardak committed 2 years ago
Verified 400d5d72
llama : add Command R Plus support (#6491)
RefractAI committed 2 years ago
Verified 5dc9dd71
license : update copyright notice + add AUTHORS (#6405)
ggerganov committed 2 years ago
Verified e11a8999
llama : fix attention layer count sanity check (#6550)
ggerganov committed 2 years ago
Verified cc4a9542
Comment explaining a decision (#6531)
kunnis committed 2 years ago
Verified cecd8d3c
quantize : fix precedence of cli args (#6541)
ggerganov committed 2 years ago
Verified b73e564b
llama : support negative ith in llama_get_ API (#6519)
TheFlipbook committed 2 years ago
Verified e3c337d8
llama : save and restore kv cache for single seq id (#6341)
kaetemi committed 2 years ago
Verified beea6e1b
remove row=1 cond (#6532)
abhilash1910 committed 2 years ago
Verified 87fb5b42
Adding KodiBot to UI list (#6535)
firatkiral committed 2 years ago
Verified d752327c
Change Windows AMD example to release build to make inference much faster. (#6525)
thebaron88 committed 2 years ago
Verified 855f5440
flake.lock: Update (#6517)
ggerganov committed 2 years ago
Verified b909236c
Add GritLM as supported models. (#6513)
dranger003 committed 2 years ago
Verified e0717e75
sync : ggml
ggerganov committed 2 years ago
Verified c3724779
ggml: bypass code incompatible with CUDA < 11.1 (whisper/2020)
primenko-v committed 2 years ago
Verified f77261a7
scripts : sync ggml-cuda folder
ggerganov committed 2 years ago
Verified 43e8995e
Run make to build the project (#6457)
limitedAtonement committed 2 years ago
Verified 9472bce3
support/fix OPs GGML_TYPE_IQ4_NL, GGML_TYPE_IQ4_XS, GGML_TYPE_IQ3_XXS, GGML_TYPE_IQ3_S, GGML_TYPE_IQ2_XXS, GGML_TYPE_IQ2_XS, GGML_TYPE_IQ2_S, GGML_TYPE_IQ1_S, GGML_TYPE_IQ1_M (#6521)
NeoZhangJianyu committed 2 years ago
Verified d4f220a5
sync : ggml
ggerganov committed 2 years ago
Verified 54ea0698
backend : fix typo in scheduler documentation (ggml/781)
danbev committed 2 years ago
Verified b66aec67
Tests: Added integration tests for GBNF parser (#6472)
HanClinto committed 2 years ago
Verified 57dd02c4
ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response (#6495)
phymbert committed 2 years ago
Verified 75cd4c77
gguf.py : add licence and version to gguf writer (#6504)
mofosyne committed 2 years ago
Verified a8bd14d5
readme : update UI list (#6503)
hugo53 committed 2 years ago
Verified d0f5deeb
bench : make n_batch and n_ubatch configurable in Batched bench (#6500)
Sunt-ing committed 2 years ago
Verified 87e21bba
[SYCL] Fixed minor bug when enabling FP16 for non intel targets (#6464)
OuadiElfarouki committed 2 years ago
Verified 1b496a74
readme : add Dot to UI list (#6487)
alexpinel committed 2 years ago
Verified a307375c
readme : fix typo (#6481)
junnjiee committed 2 years ago
Verified b660a572
server: add cURL support to server Dockerfiles (#6474)
elepedus committed 2 years ago
Verified 0a1d889e
ci: exempt master branch workflows from getting cancelled (#6486)
mscheong01 committed 2 years ago
Verified 7dda1b72
Terms Of Use Privacy Policy Refund Policy Impressum