ngxson/llama.cpp

Pull Requests Commits

ngxson committed 1 year ago

a88c0d5f

use id for mmproj tensors

ngxson committed 1 year ago

49e7304c

add more kv metadata

ngxson committed 1 year ago

c2ec8852

simple example works

ngxson committed 1 year ago

6089b0a5

ngxson committed 1 year ago

4897ff61

llava cgraph ok

ngxson committed 1 year ago

5648e30d

img pre processing

ngxson committed 1 year ago

6854ad40

model is loadable

ngxson committed 1 year ago

a75c5c42

add llava to conversion

ngxson committed 1 year ago

cd806a7e

test-backend-ops : use flops for some performance tests (#9657)

slaren committed 1 year ago

Verified 1b2f992c

llama : add comment about thread-safety [no ci] (#9449)

ggerganov committed 1 year ago

Verified 73984270

vocab : refactor tokenizer to reduce init overhead (#9449)

kylo5aby committed 1 year ago

Verified 6102037b

llama : add support for Chameleon (#8543)

nopperl committed 1 year ago

Verified 9a913110

readme : add tool (#9655)

akx committed 1 year ago

Verified 43bcdd97

ggml : add run-time detection of neon, i8mm and sve (#9331)

eddnjjn committed 1 year ago

Verified 6a0f7794

Enable use to the rebar feature to upload buffers to the device. (#9251)

mtavenrath committed 1 year ago

Verified 89f99449

readme : update hot topics

ggerganov committed 1 year ago

Verified b5de3b74

cmake : add option for common library (#9661)

iboB committed 1 year ago

Verified 44f59b43

[SYCL] add missed dll file in package (#9577)

NeoZhangJianyu committed 1 year ago

Verified 95bc82fb

mtgpu: enable VMM (#9597)

yeahdongcn committed 1 year ago

Verified 7691654c

ci : fix docker build number and tag name (#9638)

ngxson committed 1 year ago

Verified ea9c32be

ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (#9217)

chaxu01 committed 1 year ago

Verified 1e436302

server : add more env vars, improve gen-docs (#9635)

ngxson committed 1 year ago

Verified afbbfaa5

llama : add IBM Granite MoE architecture (#9438)

gabe-l-hart committed 1 year ago

Verified 3d6bf691

cann: fix crash when llama-bench is running on multiple cann devices (#9627)

bachelor-dou committed 1 year ago

Verified 904837e0

ggml : add AVX512DQ requirement for AVX512 builds (#9622)

EZForever committed 1 year ago

Verified 70392f1f

ggerganov committed 1 year ago

Verified bb5f8199

examples : adapt to ggml.h changes (ggml/0)

ggerganov committed 1 year ago

Verified c0389316

llama : keep track of all EOG tokens in the vocab (#9609)

ggerganov committed 1 year ago

Verified 31ac5834

log : add CONT level for continuing previous log entry (#9610)

ggerganov committed 1 year ago

Verified cea1486e

Older