ggerganov/llama.cpp

Pull Requests Commits

clang-tidy : disable bugprone-branch-clone

ggerganov committed 72 days ago

Verified aae2903e

sync: minja - support QwQ-32B (#12235)

ochafik committed 72 days ago

Verified 7cf64f6b

metal : simplify kernel arguments using a struct (#3229) (#12194)

BB-fat committed 72 days ago

Verified 5e2d57b2

HIP: fix rocWMMA build flags under Windows (#12230)

hjc4869 committed 72 days ago

Verified f1648e91

metal : fix default.metallib build (#12224)

danbev committed 72 days ago

Verified d6c95b07

opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (#12217)

lhez committed 73 days ago

Verified d76a86d9

cmake : fix undefined reference errors for std::filesystem in ggml (#12092) (#12094)

hbuxiaofei committed 73 days ago

Verified 776f9e59

readme : update bindings (#12229)

lmbelo committed 73 days ago

Verified 3d652bfd

CUDA: fix FA logic for PTX 7.0 and CC >= 7.5 (#12222)

JohannesGaessler committed 73 days ago

Verified 5220a16d

HIP: rocWMMA documentation and enabling in workflow builds (#12179)

hjc4869 committed 73 days ago

Verified 3ffbbd5c

update function-calling.md w/ template override for functionary-small-v3.2 (#12214)

ochafik committed 73 days ago

Verified 42994048

llava: add big-endian conversion for image encoder (#12218)

taronaeo committed 73 days ago

Verified e9b2f84f

HIP/CUDA: set the paramerter value in maintain_cuda_graph instead of replaceing it. (#12209)

IMbackK committed 73 days ago

Verified e721c05c

android : fix KV cache log message condition (#12212)

hanyin-arm committed 73 days ago

Verified 57b6abf8

opencl : fix buffer alignment (#12197)

linehill committed 74 days ago

Verified 94bb63e4

opencl : fix `ulong` kernel args were set from `int` variables (#12174)

linehill committed 74 days ago

Verified f7924399

opencl : fix profile-related errors (#12095)

simon886212 committed 74 days ago

Verified ed4ce0dd

ggml-cpu: Faster IQ1 mul_mat_vec on AVX2 using BMI2 instructions (#12154)

remyoudompheng committed 74 days ago

Verified 07d15723

SYCL: Disable f16 Unary OPs as not supported by the kernels (#12201)

qnixsynapse committed 74 days ago

Verified 5e43f104

ggml : fix GGMLMetalClass ODR (#12200)

pminev committed 74 days ago

Verified 16e4b22c

ci : add fetch-depth to xcframework upload (#12195)

danbev committed 74 days ago

Verified 074c4fd3

`tool-call`: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)

ochafik committed 74 days ago

Verified 669912d9

ci : fix xcframework artifact tag (#12191)

danbev committed 74 days ago

Verified fa31c438

ci : remove xframework upload (#12190)

danbev committed 74 days ago

Verified 3ccbfe5a

server : fix cache reuse logic (#12161)

Clauszy committed 74 days ago

Verified 06a92a19

llama : add xcframework build script (#11996)

danbev committed 74 days ago

Verified a057897a

ggml : portability fixes for VS 2017 (#12150)

mgroeber9110 committed 75 days ago

Verified 5bbe6a9f

readme : fix roadmap link (#12185)

ggerganov committed 75 days ago

Verified 20a9b8f5

main: allow preloading conversation with -p and add -st / --single-turn (#12145)

CISC committed 75 days ago

Verified 56d7a9f8

`server`: fix deadly typo in response_format.json_schema.schema handling (#12168)

ochafik committed 75 days ago

Verified 1a24c462

Older