ggerganov/llama.cpp

Pull Requests Commits

ggml-quants : avoid division by zero in make_q3_quants

compilade committed 53 days ago

fb573f44

ggml-quants : fix make_qp_quants NANs and IQ1 assertion errors

compilade committed 53 days ago

184cdc6b

vulkan: support sqrt (#15370)

ddwkim committed 53 days ago

Verified 19f4deca

convert : force patch_embd weights to F16 or F32 to avoid broken GGUFs (#15367)

CISC committed 53 days ago

Verified 4d196981

ci : fix hang in windows-hip build/release (#15365)

CISC committed 53 days ago

Verified b143fbc8

vulkan: Optimize argsort (#15354)

jeffbolznv committed 53 days ago

Verified de562791

model : support vision LiquidAI LFM2-VL family (#15347)

tdakhran committed 54 days ago

Verified 65349f26

vulkan: fuse adds (#15252)

jeffbolznv committed 54 days ago

Verified 1fe00296

vulkan: Support mul_mat_id with f32 accumulators (#15337)

jeffbolznv committed 54 days ago

Verified de219279

vulkan: Add missing bounds checking to scalar/coopmat1 mul_mat_id (#15334)

jeffbolznv committed 54 days ago

Verified 2e2b22ba

OpenCL: add initial FA support (#14987)

rmatif committed 54 days ago

Verified 912ff8c1

common : fix double bos, use common_chat_templates for add_bos and add_eos (#15326)

danbev committed 55 days ago

Verified 5e6229a8

opencl: add initial mxfp4 support via mv (#15270)

lhez committed 55 days ago

Verified e2c1bfff

vulkan : fix out-of-bounds access in argmax kernel (#15342)

ggerganov committed 55 days ago

Verified 5edf1592

vulkan : fix compile warnings on macos (#15340)

ggerganov committed 55 days ago

Verified db3010bd

ggml: initial IBM zDNN backend (#14975)

taronaeo committed 55 days ago

Verified ff27f80a

ci : fix ios-xcode-build (#15324)

CISC committed 55 days ago

Verified d3248d9b

ci : move ccache action to ggml-org fork (#15328)

slaren committed 55 days ago

Verified 7aeee88c

test-opt: fix backend support check (#15317)

JohannesGaessler committed 55 days ago

Verified b07791aa

CUDA: fix negative KV_max values in FA (#15321)

JohannesGaessler committed 56 days ago

Verified 4227c9be

eval-callback : stop on first NaN (#15320)

ggerganov committed 56 days ago

Verified df36bce6

chat : include kwargs in template example (#15309)

slaren committed 56 days ago

Verified f75b8306

llama : add 18-layer model type for Gemma 3-270m (#15319)

danbev committed 56 days ago

Verified 7a0de960

devops : fix compile bug when the BASE_CUDA_DEV_CONTAINER is based on Ubuntu 24.04 (#15005)

simevo committed 56 days ago

Verified e4e91591

HIP: Cleanup hipification header (#15285)

IMbackK committed 56 days ago

Verified 5ba36f61

gpt-oss: implement harmony parsing (#15181)

aldehir committed 56 days ago

Verified b204a5a2

docker : Enable GGML_CPU_ALL_VARIANTS for ARM (#15267)

ckastner committed 56 days ago

Verified 646944cf

readme : update hot topics (#15315)

ggerganov committed 56 days ago

Verified 1a01899b

vulkan: perf_logger improvements (#15246)

jeffbolznv committed 56 days ago

Verified 863d341e

server : add SWA checkpoints (#15293)

ggerganov committed 56 days ago

Verified d32e03f4

Older