ngxson/llama.cpp

Pull Requests Commits
blah
ngxson committed 1 year ago
00996664
test-backend-ops : use flops for some performance tests (#9657)
slaren committed 1 year ago
Verified 1b2f992c
llama : add comment about thread-safety [no ci] (#9449)
ggerganov committed 1 year ago
Verified 73984270
vocab : refactor tokenizer to reduce init overhead (#9449)
kylo5aby committed 1 year ago
Verified 6102037b
llama : add support for Chameleon (#8543)
nopperl committed 1 year ago
Verified 9a913110
readme : add tool (#9655)
akx committed 1 year ago
Verified 43bcdd97
ggml : add run-time detection of neon, i8mm and sve (#9331)
eddnjjn committed 1 year ago
Verified 6a0f7794
Enable use to the rebar feature to upload buffers to the device. (#9251)
mtavenrath committed 1 year ago
Verified 89f99449
readme : update hot topics
ggerganov committed 1 year ago
Verified b5de3b74
cmake : add option for common library (#9661)
iboB committed 1 year ago
Verified 44f59b43
[SYCL] add missed dll file in package (#9577)
NeoZhangJianyu committed 1 year ago
Verified 95bc82fb
mtgpu: enable VMM (#9597)
yeahdongcn committed 1 year ago
Verified 7691654c
ci : fix docker build number and tag name (#9638)
ngxson committed 1 year ago
Verified ea9c32be
ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (#9217)
chaxu01 committed 1 year ago
Verified 1e436302
server : add more env vars, improve gen-docs (#9635)
ngxson committed 1 year ago
Verified afbbfaa5
llama : add IBM Granite MoE architecture (#9438)
gabe-l-hart committed 1 year ago
Verified 3d6bf691
cann: fix crash when llama-bench is running on multiple cann devices (#9627)
bachelor-dou committed 1 year ago
Verified 904837e0
ggml : add AVX512DQ requirement for AVX512 builds (#9622)
EZForever committed 1 year ago
Verified 70392f1f
sync : ggml
ggerganov committed 1 year ago
Verified bb5f8199
examples : adapt to ggml.h changes (ggml/0)
ggerganov committed 1 year ago
Verified c0389316
llama : keep track of all EOG tokens in the vocab (#9609)
ggerganov committed 1 year ago
Verified 31ac5834
log : add CONT level for continuing previous log entry (#9610)
ggerganov committed 1 year ago
Verified cea1486e
server : add newline after chat example (#9616)
StrangeBytesDev committed 1 year ago
Verified 0aa15011
sampling : avoid expensive softmax during greedy sampling (#9605)
ggerganov committed 1 year ago
Verified b0f27361
threads: fix msvc build without openmp (#9615)
max-krasnyansky committed 1 year ago
Verified c087b6f1
cuda: add q8_0->f32 cpy operation (#9571)
Nekotekina committed 1 year ago
Verified 116efee0
server : add --no-context-shift option (#9607)
ngxson committed 1 year ago
Verified 0b3bf966
threads: improve ggml_barrier scaling with large number of threads (#9598)
max-krasnyansky committed 1 year ago
Verified f0c7b5ed
readme : add programmable prompt engine language CLI (#9599)
snowyu committed 1 year ago
Verified 1d48e98e
flake.lock: Update (#9586)
ggerganov committed 1 year ago
Verified f3979df7
Terms Of Use Privacy Policy Refund Policy Impressum