ngxson/llama.cpp

Pull Requests Commits
model : fix llama4 graph (#13663)
ggerganov committed 1 year ago
Verified be023969
llama : remove llama_kv_cache_view API + remove deprecated (#13653)
ggerganov committed 1 year ago
Verified a4090d11
CUDA: skip fully masked-out KV in FA vec kernel (#13584)
JohannesGaessler committed 1 year ago
Verified b69f1647
add some debug stuff
ngxson committed 1 year ago
cf9613f6
fix conversion
ngxson committed 1 year ago
3ce96d7e
tests : avoid github urls due to throttling (#13654)
CISC committed 1 year ago
Verified 759e37b0
sycl: disable reorder for sycl mulmat (#13536)
sgeor255 committed 1 year ago
Verified 4245e622
clean up audio_helpers
ngxson committed 1 year ago
3bbb26b4
Set GLM4 blk.*.attn_output.weight, kqv_out-* matmul to GGML_PREC_F32 to fix infinity values in output (#13639)
0cc4m committed 1 year ago
Verified c9c64dee
metal : fix typo in FA kernel comments (#13651)
ggerganov committed 1 year ago
Verified c00a2634
kv-cache : add SWA support (#13194)
ggerganov committed 1 year ago
Verified e298d2fb
CANN: Update CANN model support (#13162)
bachelor-dou committed 1 year ago
Verified f0adb80b
sycl : Overcoming workaround for mmap() allocation on Windows (#13482)
s-Nick committed 1 year ago
Verified f7c9429c
various fixes
ngxson committed 1 year ago
cf4f5d23
fix windows
ngxson committed 1 year ago
cf38b478
fPIC
ngxson committed 1 year ago
6f23ad18
please compile
ngxson committed 1 year ago
4a8c092c
fix compile
ngxson committed 1 year ago
1a903953
will this monster compile?
ngxson committed 1 year ago
9a0dcb6d
common : add load_progress_callback (#13617)
psocolovsky committed 1 year ago
Verified 1dfbf2cf
first working version (only 4s of audio)
ngxson committed 1 year ago
f1518541
Vulkan: Add f32 accumulator support to quantized mul mat to fix GLM4 32B incoherence (#13607)
0cc4m committed 1 year ago
Verified 8960efd0
add necessary mtmd APIs
ngxson committed 1 year ago
dce799d5
sycl : backend documentation review (#13544)
Alberto Cabrera Pérez committed 1 year ago
Verified 725f23f1
fix merge conflict
ngxson committed 1 year ago
8d7d75ae
Merge branch 'master' into xsn/mtmd_ultravox
ngxson committed 1 year ago
4d444600
mtmd : add vision support for llama 4 (#13282)
ngxson committed 1 year ago
Verified 92ecdcc0
ci : upgraded oneAPI version in SYCL workflows and dockerfile (#13532)
Alberto Cabrera Pérez committed 1 year ago
Verified f71f40a2
sync : ggml
ggerganov committed 1 year ago
d30cb5a7
mnist: fix segmentation fault (ggml/1227)
JohannesGaessler committed 1 year ago
6c35981a
Terms Of Use Privacy Policy Refund Policy Impressum