ngxson/llama.cpp

Pull Requests Commits
cuda : add FILL op support (#17851)
JayZenith committed 92 days ago
Verified 51e0c2d9
server : add development documentation (#17760)
ngxson committed 92 days ago
Verified 37a4f632
server : make cache_reuse configurable per request (#17858)
ggerganov committed 92 days ago
Verified 2bc96931
cuda: optimize SOLVE_TRI using registers and FMAF (#17703)
wsbagnsv1 committed 92 days ago
Verified 5814b4dc
ggml-cpu: add ggml_thread_cpu_relax with Zihintpause support (#17784)
ixgbe committed 92 days ago
Verified 79d61896
model: add llama 4 scaling for mistral-large (deepseek arch) (#17744)
ngxson committed 93 days ago
Verified 4d372627
Vulkan: improve mul_mat_vec_iq1_m (#16907)
lovedheart committed 93 days ago
Verified 08f9d3cc
color default is auto
ngxson committed 93 days ago
9b26375a
Merge branch 'master' into xsn/cli_server_based
ngxson committed 93 days ago
3300a7aa
fix llama2c workflow
ngxson committed 93 days ago
7d76234e
ci : add windows-cuda 13.1 release (#17839)
CISC committed 93 days ago
Verified 0a540f9a
support reasoning_content
ngxson committed 93 days ago
fa95df05
fix windows build
ngxson committed 93 days ago
f193bbfd
common : change --color to accept on/off/auto, default to auto (#17827)
CISC committed 94 days ago
Verified 22577583
sycl: add missing BF16 conversion support for Intel oneAPI (#17780)
yingying0906 committed 94 days ago
Verified d9e03db1
add arg --image and --audio
ngxson committed 94 days ago
57b8d60c
add args for speculative decoding, enable show timings by default
ngxson committed 94 days ago
9987ccb0
add /read command, improve LOG_ERR
ngxson committed 94 days ago
fb252d72
add --show-timings arg
ngxson committed 94 days ago
0799d308
add loading animation
ngxson committed 94 days ago
b9b91caf
vulkan: perf_logger improvements (#17672)
jeffbolznv committed 94 days ago
Verified db978373
ggml-zendnn : add ZenDNN backend for AMD CPUs (#17690)
z-vishal committed 94 days ago
Verified 017761da
server: support multiple generations from one prompt (OAI "n" option) (#17775)
ngxson committed 94 days ago
Verified c42712b0
move ci to llama-completion
ngxson committed 94 days ago
61de19b5
move server to a shared library
ngxson committed 94 days ago
29f03bc1
rm deprecation notice
ngxson committed 94 days ago
42e9b387
move old cli to llama-completion
ngxson committed 94 days ago
b08a4268
wip
ngxson committed 94 days ago
92610228
ggml : add circular tiling support to pad, for Vulkan, CUDA, and CPU (used for making seamless textures) (#16985)
Phylliida committed 94 days ago
Verified 09c7c50e
add args
ngxson committed 94 days ago
33551d4a
Terms Of Use Privacy Policy Refund Policy Impressum