ochafik/llama.cpp

Pull Requests Commits
Add Doc for Converting Granite Vision -> GGUF (#12006)
alex-jw-brooks committed 1 year ago
Verified 4d1051a4
llama : expose llama_model_n_head_kv in the API (#11997)
vlovich committed 1 year ago
Verified 3e9a2860
metal : copy kernels for quant to F32/F16 conversions (#12017)
gcp committed 1 year ago
Verified 58d07a80
opencl: fix for small models (#11950)
lhez committed 1 year ago
Verified 34a846b5
llava : Add Granite Vision Support (#11794)
alex-jw-brooks committed 1 year ago
Verified 7a2c913e
[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)
NeoZhangJianyu committed 1 year ago
Verified 08d59862
gguf_convert_endian.py: implement byteswapping for q4_k and q6_k (#11349)
AlekseiNikiforovIBM committed 1 year ago
Verified 651adf4b
SYCL: Fix GGML_SYCL_DEBUG macro (#11995)
qnixsynapse committed 1 year ago
Verified 8303e8b0
run: allow to customize prompt by env var LLAMA_PROMPT_PREFIX (#12041)
benoitf committed 1 year ago
Verified 7ad0779f
Some llama-run cleanups (#11973)
ericcurtin committed 1 year ago
Verified f777a73e
ggml-cpu: Support s390x SIMD Instruction Set (#12019)
taronaeo committed 1 year ago
Verified af7747c9
CUDA: app option to compile without FlashAttention (#12025)
JohannesGaessler committed 1 year ago
Verified a28e0d5e
llava: build clip image from pixels (#11999)
tinglou committed 1 year ago
Verified 36c258ee
ci : fix arm upload artifacts (#12024)
ggerganov committed 1 year ago
Verified f3e64859
CUDA: optimize FA for GQA + large batches (#12014)
JohannesGaessler committed 1 year ago
Verified 5fa07c2f
ci : Build on Github-hosted arm64 runners (#12009)
Rohanjames1997 committed 1 year ago
Verified 335eb04a
server : disable Nagle's algorithm (#12020)
ggerganov committed 1 year ago
Verified cf756d6e
cuda: Add Q5_1, Q5_0, Q4_1 and Q4_0 to F32 conversion support. (#12000)
gcp committed 1 year ago
Verified d7090842
llama.swiftui : add "Done" dismiss button to help view (#11998)
danbev committed 1 year ago
Verified de8b5a36
llama : skip loading unused tensors (#12004)
ggerganov committed 1 year ago
Verified 51f311e0
doc: update contributing guidelines [no ci] (#11969)
JohannesGaessler committed 1 year ago
Verified 586d5fe6
CUDA: correct the lowest Maxwell supported by CUDA 12 (#11984)
PureJourney committed 1 year ago
Verified ecc8e3ae
MUSA: support ARM64 and enable dp4a .etc (#11843)
BodhiHu committed 1 year ago
Verified 0b3863ff
clip : fix visual encoders with no CLS (#11982)
alex-jw-brooks committed 1 year ago
Verified ee02ad02
server (webui): Fix Premature Submission During IME Conversion (#11971)
mmngays committed 1 year ago
Verified c392e509
ggml-cpu: Add CPU backend support for KleidiAI library (#11390)
chaxu01 committed 1 year ago
Verified c5d91a74
ggml: aarch64: implement SVE kernels for q3_K_q8_K vector dot (#11917)
Vithulep committed 1 year ago
Verified 4806498b
run : add --chat-template-file (#11961)
engelmi committed 1 year ago
Verified 0d559580
doc: add links to ggml examples [no ci] (#11958)
JohannesGaessler committed 1 year ago
Verified d04e7163
common : add llama.vim preset for Qwen2.5 Coder (#11945)
danbev committed 1 year ago
Verified d07c6213
Terms Of Use Privacy Policy Refund Policy Impressum