ggerganov/llama.cpp

Pull Requests Commits

Vulkan: Add renderdoc tracing support

0cc4m committed 130 days ago

9af90481

gguf-py: fixed local detection of gguf package (#11180)

VJHack committed 132 days ago

Verified c05e8c99

convert : sort print supported models [no ci] (#11179)

danbev committed 132 days ago

Verified 2739a71e

examples : add README.md to tts example [no ci] (#11155)

danbev committed 133 days ago

Verified ba8a1f9c

convert : add --print-supported-models option (#11172)

danbev committed 133 days ago

Verified ff3fcabc

Vulkan: Fix float16 use on devices without float16 support + fix subgroup_size_control validation error (#11161)

0cc4m committed 133 days ago

Verified c3f9d257

llama: add support for QRWKV6 model architecture (#11001)

MollySophia committed 133 days ago

Verified ee7136c6

SYCL: Refactor ggml_sycl_compute_forward (#11121)

qnixsynapse committed 133 days ago

Verified c6860cc7

doc: add cuda guide for fedora (#11135)

teihome committed 134 days ago

Verified 1204f972

server : add tooltips to settings and themes btn (#11154)

danbev committed 134 days ago

Verified 8eceb888

model: Add support for PhiMoE arch (#11003)

phymbert committed 134 days ago

Verified f8feb4b0

media : remove old img [no ci]

ggerganov committed 134 days ago

Verified be0e950c

llama-chat : add phi 4 template (#11148)

ngxson committed 134 days ago

Verified d9feae1c

fix: add missing msg in static_assert (#11143)

hydai committed 134 days ago

Verified 8d59d911

gguf-py : move scripts directory (#11116)

VJHack committed 134 days ago

Verified 8a1d9c25

Enhance user input handling for llama-run (#11138)

ericcurtin committed 134 days ago

Verified 1bf839b1

ci : use actions from ggml-org (#11140)

ngxson committed 134 days ago

Verified f7cd1330

lora : improve compat with `mergekit-extract-lora` (#11131)

ngxson committed 134 days ago

Verified 4d2b3d88

llama : avoid hardcoded QK_K (#11061)

ggerganov committed 134 days ago

Verified c07d437b

ggerganov committed 135 days ago

Verified 99a3755a

ggml : allow loading backend with env variable (ggml/1059)

rgerganov committed 135 days ago

Verified c792dcf4

ci : pin dependency to specific version (#11137)

ngxson committed 135 days ago

Verified 80ccf5d7

arg : option to exclude arguments from specific examples (#11136)

ggerganov committed 135 days ago

Verified a3c1232c

llamafile : ppc64le MMA INT8 implementation (#10912)

amritahs-ibm committed 135 days ago

Verified 8cef75c7

ci : fix cmake option (#11125)

ggerganov committed 135 days ago

Verified 0d52a69e

Disable GL_KHR_cooperative_matrix Vulkan extension if not available. (#11117)

mbaudier committed 135 days ago

Verified 02f04301

fix: Vulkan shader gen binary path when Cross-compiling (#11096)

ag2s20150909 committed 135 days ago

Verified bec2183f

GGUF: C++ refactor, backend support, misc fixes (#11030)

JohannesGaessler committed 135 days ago

Verified 53ff6b9b

ggml-backend : only offload from host buffers (fix) (#11124)

slaren committed 135 days ago

Verified 017cc5f4

ggml-backend : only offload from host buffers (#11120)

slaren committed 136 days ago

Verified a3d50bc0

Older