ggerganov/llama.cpp

Pull Requests Commits
server : fix img token logs (#16595)
ggerganov committed 21 days ago
Verified 17304cbc
llama-quant: add support for mmproj (#16592)
ngxson committed 21 days ago
Verified 3e3cb19f
CUDA: Changing the CUDA scheduling strategy to spin (#16585)
JTischbein committed 22 days ago
Verified 5acd4554
server : fix mtmd checkpoints (#16591)
ggerganov committed 22 days ago
Verified 554fd578
metal : avoid using Metal's gpuAddress property (#16576)
ggerganov committed 22 days ago
Verified fa882fd2
vulkan: Add ACC_TYPE_VEC2 implementation (#16203)
SavicStefan committed 22 days ago
Verified ffa05903
CUDA + openCL: fix bug in accessing rms_norm->src while doing fusion (#16577)
am17an committed 22 days ago
Verified 120bf704
vulkan: Support FA with K/V in F32 (#16543)
jeffbolznv committed 22 days ago
Verified 4258e0cf
vulkan: Improve build time for MSVC (#16545)
jeffbolznv committed 22 days ago
Verified 7ea15bb6
CUDA: enable FA for FP32 KV cache (#16546)
JohannesGaessler committed 22 days ago
Verified 9c7185dd
CUDA: use fastdiv + ggml_cuda_mad for mmvf (#16557)
am17an committed 23 days ago
Verified 1ee9d0b4
CUDA: add fp kernel for larger batch size MoE (#16512)
am17an committed 23 days ago
Verified 48e2fa9f
cuda : remove legacy copy-op pointer indirection code (#16485)
anavp-nvidia committed 23 days ago
Verified 5b6913c4
server : dynamic token limit for prompt cache (#16560)
ggerganov committed 23 days ago
Verified bc07349a
metal : FA support F32 K and V and head size = 32 (#16531)
ggerganov committed 23 days ago
Verified e60f241e
graph : support cacheless embeddings with FA and iSWA (#16528)
ggerganov committed 23 days ago
Verified e38b7c6e
opencl: fix build targeting CL 2 (#16554)
lhez committed 23 days ago
Verified 5016b728
CUDA: fix numerical issues in tile FA kernel (#16540)
JohannesGaessler committed 23 days ago
Verified 7049736b
ggml : fix build broken with -march=armv9-a on MacOS (#16520)
DamonFool committed 23 days ago
Verified 01d2bdc2
CANN: fix CPU memory leak in CANN backend (#16549)
noemotiovon committed 24 days ago
Verified 56fc38b9
fix: add remark plugin to render raw HTML as literal text (#16505)
ServeurpersoCom committed 24 days ago
Verified 1fb9504e
metal: add support for opt_step_sgd (#16539)
cern1710 committed 24 days ago
Verified 3f750f8d
ggml : fix scalar path for computing norm (#16558)
ggerganov committed 24 days ago
Verified c515fc57
CANN: Update several operators to support FP16 data format (#16251)
hipudding committed 24 days ago
Verified f9bc66c3
metal : add opt_step_adamw and op_sum (#16529)
cern1710 committed 24 days ago
Verified a31cf36a
webui: remove client-side context pre-check and rely on backend for limits (#16506)
ServeurpersoCom committed 24 days ago
Verified 81d54bbf
[SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521)
NeoZhangJianyu committed 24 days ago
Verified c7be9feb
ci : add Vulkan on Ubuntu with default packages build (#16532)
mbaudier committed 24 days ago
Verified 8415f61e
common : handle unicode during partial json parsing (#16526)
aldehir committed 24 days ago
Verified 2c301e91
common : update presets (#16504)
ggerganov committed 25 days ago
Verified 4b2dae38
Terms Of Use Privacy Policy Refund Policy Impressum