ggerganov/llama.cpp

Pull Requests Commits
metal : fix the fix
ggerganov committed 1 year ago
Verified 072c56fc
readme : add notice about the bug fix
ggerganov committed 1 year ago
Verified 3966d681
metal : proper assert for mat-mat memory alignment
ggerganov committed 1 year ago
Verified 2f8be164
metal : pad n_ctx by 32 (#6177)
ggerganov committed 1 year ago
Verified 95d576b4
add blog link (#6222)
NeoZhangJianyu committed 1 year ago
Verified 59c17f02
Fix params underscore convert to dash. (#6203)
dranger003 committed 1 year ago
Verified fa046eaf
server : update readme doc from `slot_id` to `id_slot` (#6213)
kaetemi committed 1 year ago
Verified be07a032
cuda : disable host register by default (#6206)
slaren committed 1 year ago
Verified d0a71233
Corrected typo to wrong file (#6199)
semidark committed 1 year ago
Verified f372c49c
tests : disable system() calls (#6198)
ggerganov committed 1 year ago
Verified 924ce1dc
cuda : fix LLAMA_CUDA_F16 build (#6197)
slaren committed 1 year ago
Verified 03a8f8fa
ggml : same IQ4_NL quantization for CPU/CUDA/Metal (#6196)
ikawrakow committed 1 year ago
Verified cfd3be76
json-schema-to-grammar improvements (+ added to server) (#5978)
ochafik committed 1 year ago
Verified 5b7b0ac8
ci : fix indentation error (#6195)
Vaibhavs10 committed 1 year ago
Verified 1943c019
build : add mac pre-build binaries (#6182)
Vaibhavs10 committed 1 year ago
Verified 5e43ba87
Add ability to use Q5_0, Q5_1, and IQ4_NL for quantized K cache (#6183)
ikawrakow committed 1 year ago
Verified 76aa30a2
Add nvidia and amd backends (#6157)
AidanBeltonS committed 1 year ago
Verified c5b8595e
cuda : fix conflict with std::swap (#6186)
slaren committed 1 year ago
Verified 42e21c68
cuda : print the returned error when CUDA initialization fails (#6185)
slaren committed 1 year ago
Verified 1c51f98a
llava : update MobileVLM-README.md (#6180)
ZiangWu-77 committed 1 year ago
Verified f9c7ba34
llava : add MobileVLM_V2 backup (#6175)
ZiangWu-77 committed 1 year ago
Verified 272935b2
cuda : refactor to remove global resources (#6170)
slaren committed 1 year ago
Verified ccf58aa3
Server: version bump for httplib and json (#6169)
ngxson committed 1 year ago
Verified 91f8ad16
gitignore : ignore curl-related files
ggerganov committed 1 year ago
Verified 6b7e76d2
server : allow to override -ngl in tests (#6170)
ggerganov committed 1 year ago
Verified bc0baab2
Revert "llava : add a MobileVLM_V2-1.7B backup (#6152)"
ggerganov committed 1 year ago
Verified d795988d
llava : add a MobileVLM_V2-1.7B backup (#6152)
ZiangWu-77 committed 1 year ago
Verified f8c4e745
Server: Handle n_keep parameter in the request (#6174)
jkarthic committed 1 year ago
Verified 47cc7a7b
server tests : more pythonic process management; fix bare `except:` (#6146)
cebtenzzre committed 1 year ago
Verified bd60d82d
update readme sycl for new update (#6151)
NeoZhangJianyu committed 1 year ago
Verified 6c0b2877
Terms Of Use Privacy Policy Refund Policy Impressum