ggerganov/llama.cpp

Pull Requests Commits

correct token count

ngxson committed 9 hours ago

3a798bf2

apply review comments

ngxson committed 9 hours ago

07335164

ngxson committed 18 hours ago

9c9a1546

use GGML_ROPE_TYPE_VISION

ngxson committed 18 hours ago

e66e94f0

ngxson committed 18 hours ago

d692634f

handle min/max token counts from CLI

ngxson committed 18 hours ago

4b51a5f2

mtmd: support DeepSeek-V4-Flash-Vision-Exp

ngxson committed 18 hours ago

3712aed6

metal : add fa-vec tunings for M1 Ultra (#28088)

ozgursoy committed 22 hours ago

Verified 458681e1

CUDA: XOR swizzle flash attn K,V smem fp16 tiles (#25635)

ynankani committed 23 hours ago

Verified e4b9af00

metal : add concat support for quantized types (#28116)

ggerganov committed 23 hours ago

Verified ab0b3bd3

AVX2: Speed up large batch size prompt processing of IQ models (#27402)

bartowski1182 committed 1 day ago

Verified 85c55223

metal : add top-k radix implementation (#28073)

ggerganov committed 1 day ago

Verified 2a74817f

kv-cache : optimize restoring non-contiguous cells (#27991)

itsnotoger committed 1 day ago

Verified 2d8d612e

opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance (#26438)

wanghqc committed 1 day ago

Verified 010be968

ui: copy the displayed text of grouped agentic responses (#27832)

ServeurpersoCom committed 1 day ago

Verified 774ee0e2

webgpu : avoid crash when offset is not multiple of 4 in WebGPU ggml_backend_tensor_get() implementation (#28045)

fairydreaming committed 1 day ago

Verified 8e53fcef

ROCm: add radix TOP_K for long rows (#27466)

jadenmach2 committed 1 day ago

Verified f8dbcd61

metal : add fa-vec tunings for M1 (#28078)

nikwen committed 1 day ago

Verified 5d4a3be2

CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were restricted to 1 token (#27621)

ynankani committed 1 day ago

Verified 41ef91f7

sycl : Enhance to get the free memory of Intel GPU (#27968)

arthw committed 1 day ago

Verified a32af33d

ci : add check for unzip (#28082)

CISC committed 1 day ago

Verified 580e88d8

spec : fuse the DFlash encoder into the KV cache injection (#27310)

wjinxu committed 1 day ago

Verified 662a0b01

vulkan: tune mat-vec rows for batched inference on Strix Halo (#27909)

SimonTeixidor committed 1 day ago

Verified 2cdae802

ggml : add MUL_MAT to the list of ops that may need additional memory (for WebGPU) (#28071)

fairydreaming committed 1 day ago

Verified 557614e0

vulkan: top_k radix select for k >= 1024 for Qwen 3.8 Flash Next (#28032)

0cc4m committed 1 day ago

Verified daef7b68

hexagon: fix CPY fence bug (#28033)

yshsharke committed 2 days ago

Verified 9723942a

metal : add remaining Q4_1/Q5_0/Q5_1 fa-vec tunings for M2 (#28017)

ring2003 committed 2 days ago

Verified bd55e6aa

rpc: avoid serializing buffers from other servers (#26500)

hmirin committed 2 days ago

Verified a7cc83bb

ggml : fix ggml_backend_buft_get_alloc_size() guard (#28038)

ggerganov committed 2 days ago

Verified 6d1479c1

kv-cells: stop the sequence scan once all sequences are seen (#28011)

ServeurpersoCom committed 2 days ago

Verified 62acc89c

Older