ggml-org/llama.cpp

Pull Requests Commits

fix: apply clang-format to CUDA macros (#16017)

bugparty committed 1 hour ago

Verified f1fbffb5

ci : update macos-latest* jobs to use macos-latest (#15938)

danbev committed 4 hours ago

Verified 51abc96b

cmake : Do not install tools on iOS targets (#15903)

ykhrustalev committed 6 hours ago

Verified 07808ebb

Add LLaDA-7b-MoE diffusion model (#16003)

am17an committed 6 hours ago

Verified 6d758839

CUDA: fix im2col_3d to respect non-contiguous inputs (views) (#15956)

jakekarnes42 committed 10 hours ago

Verified 3d4053f7

docker : enable rocWMMA in ROCm images, add gfx1151 (#15997)

slaren committed 11 hours ago

Verified dc381aa9

releases : switch to rocWMMA develop branch, add gfx1151 (#15992)

slaren committed 11 hours ago

Verified 10d19740

SYCL: Add COUNT_EQUAL operator support (#15991)

yael-works committed 16 hours ago

Verified b907255f

llama-run: Fix model download on Windows (#15988)

npopov-vst committed 22 hours ago

Verified 28c39da7

CUDA: some micro-optimizations in mmf.cuh for mul_mat_id (#15926)

am17an committed 23 hours ago

Verified 10622056

fix KLD percentile output (#15999)

ddh0 committed 1 day ago

Verified a68f31ed

model : add grok-2 support (#15539)

CISC committed 1 day ago

Verified b8e09f08

server : only attempt to enable thinking if using jinja (#15967)

CISC committed 1 day ago

Verified 6c019cb0

metal : remove memory pools (#15966)

ggerganov committed 1 day ago

Verified 9dcd200d

rocm.Dockerfile: added gfx1200,gfx1201 architectures to support AMD Radeon RX 9000 series (#15994)

channeladam committed 1 day ago

Verified 0fa154e3

Vulkan: Clean up mul_mm shader (#15987)

0cc4m committed 1 day ago

Verified 261e6a20

build: fix the build failures of Windows HIP release job (#15984)

lcy0321 committed 1 day ago

Verified a0e13dcb

metal : fix kernel requirements (#15983)

ggerganov committed 1 day ago

Verified a14bd350

rpc : fix regression when --device is used (#15981)

rgerganov committed 1 day ago

Verified 918b26f1

releases : update ROCM, add gfx1200, gfx1201, gfx1151 (#15972)

slaren committed 1 day ago

Verified 9ecb8843

doc : update documentation for --tensor-split (#15980)

rgerganov committed 1 day ago

Verified d1c6f11f

ggml-zdnn: rm user mapped buffers (#15965)

taronaeo committed 2 days ago

Verified 6380d6a3

vulkan: fix failing dequant shaders (#15862)

jeffbolznv committed 2 days ago

Verified aa0c461e

vulkan: initialize vulkan-hpp to allow using extension function pointers (#15705)

jeffbolznv committed 2 days ago

Verified b9c9c9f7

llama : allow using iGPUs with --device (#15951)

slaren committed 2 days ago

Verified 50f4281a

metal : refactor kernel loading (#15964)

ggerganov committed 2 days ago

Verified 55758b00

metal : allow ops to run concurrently (#15929)

ggerganov committed 2 days ago

Verified f161463a

metal : fix memory leaks (#15962)

ggerganov committed 2 days ago

Verified 84d7b2fc

ggml-zdnn: fix #15414, activate FP16 and BF16 acceleration and incorrect zTensor free (#15839)

taronaeo committed 3 days ago

Verified 40be5115

Add docker protocol support for llama-server model loading (#15790)

ericcurtin committed 3 days ago

Verified 4bf55492

Older