ggerganov/llama.cpp

Pull Requests Commits
musa: support new arch mp_31 and update doc (#12296)
yeahdongcn committed 214 days ago
Verified 25136454
opencl: use OpenCL C standard supported by the device (#12221)
Henry Linjamäki committed 214 days ago
Verified 8acdacb3
readme: added Sidekick to available UIs (#12311)
johnbean393 committed 214 days ago
Verified 89b2b56e
tests : fix test-quantize-fns to init the CPU backend (#12306)
ggerganov committed 214 days ago
Verified e128a1bf
common : refactor '-o' option (#12278)
marcoStocchi committed 214 days ago
Verified 6ef79a67
`server`: extract <think> tags from qwq outputs (#12297)
ochafik committed 214 days ago
Verified 4e39a3c3
`tool-call`: ensure there's always a non-empty tool call id (#12292)
ochafik committed 214 days ago
Verified be421fc4
allow missing content in message if tool_calls provided (#12293)
ochafik committed 214 days ago
Verified 87c26305
`sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string) (#12291)
ochafik committed 214 days ago
Verified 2b3a25c2
llava : fix bug in minicpm-v code (#11513)
tc-mb committed 214 days ago
Verified 8352cdc8
server : add speculative decoding presets for FIM (#12287)
ggerganov committed 215 days ago
Verified 1e2f78a0
authors : update (#12271)
ggerganov committed 216 days ago
Verified 0fd7ca7a
ggml-backend : make path_str compatible with C++20 (#12269)
ctrysbita committed 216 days ago
Verified 6fefc05a
server : infill gen ends on new line (#12254)
ggerganov committed 217 days ago
Verified 7ab36439
ggml : skip intermediate .air file when compiling .metallib (#12247)
danbev committed 217 days ago
Verified 7c7f3b7f
sync : ggml
ggerganov committed 217 days ago
102ac189
ggml : ggml_compute_forward_concat() for arbitrary tensor type (ggml/1118)
vmobilis committed 217 days ago
d6ae2fa0
ggml-cpu: faster AVX2 variant for IQ1_M (#12216)
remyoudompheng committed 217 days ago
Verified 68d0027f
ci : fix save-load test invocations (#12245)
ggerganov committed 217 days ago
Verified ea002810
server : Log original chat template parsing error (#12233)
CISC committed 217 days ago
Verified 8fad3c7a
sync: minja - support QwQ-32B (#12235)
ochafik committed 217 days ago
Verified 7cf64f6b
metal : simplify kernel arguments using a struct (#3229) (#12194)
BB-fat committed 217 days ago
Verified 5e2d57b2
HIP: fix rocWMMA build flags under Windows (#12230)
hjc4869 committed 217 days ago
Verified f1648e91
metal : fix default.metallib build (#12224)
danbev committed 217 days ago
Verified d6c95b07
opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (#12217)
lhez committed 217 days ago
Verified d76a86d9
cmake : fix undefined reference errors for std::filesystem in ggml (#12092) (#12094)
hbuxiaofei committed 217 days ago
Verified 776f9e59
readme : update bindings (#12229)
lmbelo committed 218 days ago
Verified 3d652bfd
CUDA: fix FA logic for PTX 7.0 and CC >= 7.5 (#12222)
JohannesGaessler committed 218 days ago
Verified 5220a16d
HIP: rocWMMA documentation and enabling in workflow builds (#12179)
hjc4869 committed 218 days ago
Verified 3ffbbd5c
update function-calling.md w/ template override for functionary-small-v3.2 (#12214)
ochafik committed 218 days ago
Verified 42994048
Terms Of Use Privacy Policy Refund Policy Impressum