ochafik/llama.cpp

Pull Requests Commits
server : fix first message identification (#13634)
doringeman committed 1 year ago
Verified 42158ae2
kv-cache : simplify the interface (#13660)
ggerganov committed 1 year ago
Verified 797f2ac0
model : disable SWA for Phi models (#13676)
ggerganov committed 1 year ago
Verified b44890df
musa: Upgrade MUSA SDK version to rc4.0.1 and use mudnn::Unary::IDENTITY op to accelerate D2D memory copy (#13647)
yeahdongcn committed 1 year ago
Verified 33983057
vulkan: fix warnings (#13626)
netrunnereve committed 1 year ago
Verified fb1cab20
mtmd-helper : bug fix to token batching in mtmd (#13650)
l3utterfly committed 1 year ago
Verified b7a17463
model : fix llama4 graph (#13663)
ggerganov committed 1 year ago
Verified be023969
llama : remove llama_kv_cache_view API + remove deprecated (#13653)
ggerganov committed 1 year ago
Verified a4090d11
CUDA: skip fully masked-out KV in FA vec kernel (#13584)
JohannesGaessler committed 1 year ago
Verified b69f1647
tests : avoid github urls due to throttling (#13654)
CISC committed 1 year ago
Verified 759e37b0
sycl: disable reorder for sycl mulmat (#13536)
sgeor255 committed 1 year ago
Verified 4245e622
Set GLM4 blk.*.attn_output.weight, kqv_out-* matmul to GGML_PREC_F32 to fix infinity values in output (#13639)
0cc4m committed 1 year ago
Verified c9c64dee
metal : fix typo in FA kernel comments (#13651)
ggerganov committed 1 year ago
Verified c00a2634
kv-cache : add SWA support (#13194)
ggerganov committed 1 year ago
Verified e298d2fb
CANN: Update CANN model support (#13162)
bachelor-dou committed 1 year ago
Verified f0adb80b
sycl : Overcoming workaround for mmap() allocation on Windows (#13482)
s-Nick committed 1 year ago
Verified f7c9429c
common : add load_progress_callback (#13617)
psocolovsky committed 1 year ago
Verified 1dfbf2cf
Vulkan: Add f32 accumulator support to quantized mul mat to fix GLM4 32B incoherence (#13607)
0cc4m committed 1 year ago
Verified 8960efd0
sycl : backend documentation review (#13544)
Alberto Cabrera Pérez committed 1 year ago
Verified 725f23f1
mtmd : add vision support for llama 4 (#13282)
ngxson committed 1 year ago
Verified 92ecdcc0
ci : upgraded oneAPI version in SYCL workflows and dockerfile (#13532)
Alberto Cabrera Pérez committed 1 year ago
Verified f71f40a2
sync : ggml
ggerganov committed 1 year ago
d30cb5a7
mnist: fix segmentation fault (ggml/1227)
JohannesGaessler committed 1 year ago
6c35981a
ggml : fix apple OS check in ggml_print_backtrace (ggml/1229)
slaren committed 1 year ago
8b5e19ae
ggml : Fix missing backtrace on Linux (ggml/1228)
danielzgtg committed 1 year ago
60aea028
fix: check model pointer validity before use (#13631)
D2hugging committed 1 year ago
Verified 9c55e5c5
CANN: Support MOE Model MUL_MAT_ID (#13042)
noemotiovon committed 1 year ago
Verified 33d7aed4
server : added --no-prefill-assistant flag (#13608)
isaac-mcfadyen committed 1 year ago
Verified 6a2bc8bf
cmake: use the current build config for vulkan-shaders-gen (#13595)
giladgd committed 1 year ago
Verified e3a7cf6c
parallel : add option for non-shared and larger prompts (#13598)
ggerganov committed 1 year ago
Verified 518329b2
Terms Of Use Privacy Policy Refund Policy Impressum