ggml-org/llama.cpp

Pull Requests Commits

Revert "sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 12…" (#28184)

Titaniumtown committed 4 days ago

Verified c845263f

sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 1280 (#28016)

philip-jingxin committed 4 days ago

Verified 1f3d3187

metal : add fa-vec tuning for M2 Pro (#28122)

lstolcman committed 4 days ago

Verified 8887a48f

metal : add fa-vec tunings for A18 Pro (MacBook Neo) (#28152)

jhen0409 committed 4 days ago

Verified be789c34

model : load hparams.n_layer_nextn before n_layer() calls (#28159)

CISC committed 4 days ago

Verified 9d817213

metal : fix more leaks due to missing autoreleasepools (#27883)

nikwen committed 4 days ago

Verified fe2120bc

metal : add fa-vec tuning for M2 Max (#28015)

ggerganov committed 4 days ago

Verified d08c7872

sycl : support limit max alloc memory within 2GB for host-pinned memory (#27559)

arthw committed 4 days ago

Verified 5eec3ad0

qwen4exp: fix seq_cp, block position keying, mtmd input, cuda abort, add tests (#27941)

danielhanchen committed 4 days ago

Verified 36b10154

tests : fix log verbosity for test-llama-archs (#28147)

ggerganov committed 4 days ago

Verified d086dbb3

quantize: row-slab stream to avoid thread starvation (#27830)

ngxson committed 4 days ago

Verified 1b89a43e

metal: enable Metal 4.0 tensor API on M5+/A19+ (#27461)

JamesFranc committed 4 days ago

Verified d5d993a0

ci: Bump ggml-org/ccache-action to v1.2.24 (#28083)

luhenry committed 4 days ago

Verified 234a6eba

kleidiai : Update KleidiAI Documentation (#26078)

JonathanC-ARM committed 4 days ago

Verified 518b7623

qwen4exp: support recurrent state rollback (#28123)

ServeurpersoCom committed 4 days ago

Verified 0eadefeb

qwen4exp: sum the indexer heads by slices (#28023)

ServeurpersoCom committed 4 days ago

Verified 09412af3

metal : add fa-vec tunings for M1 Ultra (#28088)

ozgursoy committed 5 days ago

Verified 458681e1

CUDA: XOR swizzle flash attn K,V smem fp16 tiles (#25635)

ynankani committed 5 days ago

Verified e4b9af00

metal : add concat support for quantized types (#28116)

ggerganov committed 5 days ago

Verified ab0b3bd3

AVX2: Speed up large batch size prompt processing of IQ models (#27402)

bartowski1182 committed 5 days ago

Verified 85c55223

metal : add top-k radix implementation (#28073)

ggerganov committed 5 days ago

Verified 2a74817f

kv-cache : optimize restoring non-contiguous cells (#27991)

itsnotoger committed 5 days ago

Verified 2d8d612e

opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance (#26438)

wanghqc committed 5 days ago

Verified 010be968

ui: copy the displayed text of grouped agentic responses (#27832)

ServeurpersoCom committed 5 days ago

Verified 774ee0e2

webgpu : avoid crash when offset is not multiple of 4 in WebGPU ggml_backend_tensor_get() implementation (#28045)

fairydreaming committed 5 days ago

Verified 8e53fcef

ROCm: add radix TOP_K for long rows (#27466)

jadenmach2 committed 5 days ago

Verified f8dbcd61

metal : add fa-vec tunings for M1 (#28078)

nikwen committed 5 days ago

Verified 5d4a3be2

CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were restricted to 1 token (#27621)

ynankani committed 5 days ago

Verified 41ef91f7

sycl : Enhance to get the free memory of Intel GPU (#27968)

arthw committed 5 days ago

Verified a32af33d

ci : add check for unzip (#28082)

CISC committed 5 days ago

Verified 580e88d8

Newer Older