ngxson/llama.cpp

Pull Requests Commits
common : refactor '-o' option (#12278)
marcoStocchi committed 301 days ago
Verified 6ef79a67
`server`: extract <think> tags from qwq outputs (#12297)
ochafik committed 301 days ago
Verified 4e39a3c3
`tool-call`: ensure there's always a non-empty tool call id (#12292)
ochafik committed 301 days ago
Verified be421fc4
allow missing content in message if tool_calls provided (#12293)
ochafik committed 301 days ago
Verified 87c26305
`sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string) (#12291)
ochafik committed 301 days ago
Verified 2b3a25c2
llava : fix bug in minicpm-v code (#11513)
tc-mb committed 301 days ago
Verified 8352cdc8
server : add speculative decoding presets for FIM (#12287)
ggerganov committed 301 days ago
Verified 1e2f78a0
authors : update (#12271)
ggerganov committed 302 days ago
Verified 0fd7ca7a
ggml-backend : make path_str compatible with C++20 (#12269)
ctrysbita committed 302 days ago
Verified 6fefc05a
server : infill gen ends on new line (#12254)
ggerganov committed 303 days ago
Verified 7ab36439
ggml : skip intermediate .air file when compiling .metallib (#12247)
danbev committed 303 days ago
Verified 7c7f3b7f
sync : ggml
ggerganov committed 303 days ago
102ac189
ggml : ggml_compute_forward_concat() for arbitrary tensor type (ggml/1118)
vmobilis committed 303 days ago
d6ae2fa0
ggml-cpu: faster AVX2 variant for IQ1_M (#12216)
remyoudompheng committed 304 days ago
Verified 68d0027f
ci : fix save-load test invocations (#12245)
ggerganov committed 304 days ago
Verified ea002810
server : Log original chat template parsing error (#12233)
CISC committed 304 days ago
Verified 8fad3c7a
sync: minja - support QwQ-32B (#12235)
ochafik committed 304 days ago
Verified 7cf64f6b
metal : simplify kernel arguments using a struct (#3229) (#12194)
BB-fat committed 304 days ago
Verified 5e2d57b2
HIP: fix rocWMMA build flags under Windows (#12230)
hjc4869 committed 304 days ago
Verified f1648e91
metal : fix default.metallib build (#12224)
danbev committed 304 days ago
Verified d6c95b07
opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (#12217)
lhez committed 304 days ago
Verified d76a86d9
cmake : fix undefined reference errors for std::filesystem in ggml (#12092) (#12094)
hbuxiaofei committed 304 days ago
Verified 776f9e59
readme : update bindings (#12229)
lmbelo committed 304 days ago
Verified 3d652bfd
CUDA: fix FA logic for PTX 7.0 and CC >= 7.5 (#12222)
JohannesGaessler committed 304 days ago
Verified 5220a16d
HIP: rocWMMA documentation and enabling in workflow builds (#12179)
hjc4869 committed 304 days ago
Verified 3ffbbd5c
update function-calling.md w/ template override for functionary-small-v3.2 (#12214)
ochafik committed 305 days ago
Verified 42994048
llava: add big-endian conversion for image encoder (#12218)
taronaeo committed 305 days ago
Verified e9b2f84f
HIP/CUDA: set the paramerter value in maintain_cuda_graph instead of replaceing it. (#12209)
IMbackK committed 305 days ago
Verified e721c05c
android : fix KV cache log message condition (#12212)
hanyin-arm committed 305 days ago
Verified 57b6abf8
opencl : fix buffer alignment (#12197)
linehill committed 305 days ago
Verified 94bb63e4
Terms Of Use Privacy Policy Refund Policy Impressum