ggml-org/llama.cpp

Pull Requests Commits

quantize: be able to specify the token embedding tensor type

Iwan Kawrakow committed 1 year ago

0e826d12

quantize: be able to specify the output tensor type

Iwan Kawrakow committed 1 year ago

7883796f

ci : add CURL flag for the mac builds (#6214)

Vaibhavs10 committed 1 year ago

Verified b2075fd6

metal : pad n_ctx by 32 (#6177)

ggerganov committed 1 year ago

Verified 95d576b4

add blog link (#6222)

NeoZhangJianyu committed 1 year ago

Verified 59c17f02

Fix params underscore convert to dash. (#6203)

dranger003 committed 1 year ago

Verified fa046eaf

server : update readme doc from `slot_id` to `id_slot` (#6213)

kaetemi committed 1 year ago

Verified be07a032

cuda : disable host register by default (#6206)

slaren committed 1 year ago

Verified d0a71233

Corrected typo to wrong file (#6199)

semidark committed 1 year ago

Verified f372c49c

tests : disable system() calls (#6198)

ggerganov committed 1 year ago

Verified 924ce1dc

cuda : fix LLAMA_CUDA_F16 build (#6197)

slaren committed 1 year ago

Verified 03a8f8fa

ggml : same IQ4_NL quantization for CPU/CUDA/Metal (#6196)

ikawrakow committed 1 year ago

Verified cfd3be76

json-schema-to-grammar improvements (+ added to server) (#5978)

ochafik committed 1 year ago

Verified 5b7b0ac8

ci : fix indentation error (#6195)

Vaibhavs10 committed 1 year ago

Verified 1943c019

build : add mac pre-build binaries (#6182)

Vaibhavs10 committed 1 year ago

Verified 5e43ba87

Add ability to use Q5_0, Q5_1, and IQ4_NL for quantized K cache (#6183)

ikawrakow committed 1 year ago

Verified 76aa30a2

Add nvidia and amd backends (#6157)

AidanBeltonS committed 1 year ago

Verified c5b8595e

cuda : fix conflict with std::swap (#6186)

slaren committed 1 year ago

Verified 42e21c68

cuda : print the returned error when CUDA initialization fails (#6185)

slaren committed 1 year ago

Verified 1c51f98a

llava : update MobileVLM-README.md (#6180)

ZiangWu-77 committed 1 year ago

Verified f9c7ba34

llava : add MobileVLM_V2 backup (#6175)

ZiangWu-77 committed 1 year ago

Verified 272935b2

cuda : refactor to remove global resources (#6170)

slaren committed 1 year ago

Verified ccf58aa3

Server: version bump for httplib and json (#6169)

ngxson committed 1 year ago

Verified 91f8ad16

gitignore : ignore curl-related files

ggerganov committed 1 year ago

Verified 6b7e76d2

server : allow to override -ngl in tests (#6170)

ggerganov committed 1 year ago

Verified bc0baab2

Revert "llava : add a MobileVLM_V2-1.7B backup (#6152)"

ggerganov committed 1 year ago

Verified d795988d

llava : add a MobileVLM_V2-1.7B backup (#6152)

ZiangWu-77 committed 1 year ago

Verified f8c4e745

Server: Handle n_keep parameter in the request (#6174)

jkarthic committed 1 year ago

Verified 47cc7a7b

server tests : more pythonic process management; fix bare `except:` (#6146)

cebtenzzre committed 1 year ago

Verified bd60d82d

update readme sycl for new update (#6151)

NeoZhangJianyu committed 1 year ago

Verified 6c0b2877

Older