ggerganov/llama.cpp

Pull Requests Commits

ggml-cuda : use i and j instead of i0 and i in vec_dot_tq2_0_q8_1

compilade committed 1 year ago

fbddb262

ggml-metal : supports_op returns false for ternary types

compilade committed 1 year ago

b6fc9f03

ggml-cuda : slight optimizations for TQ2_0

compilade committed 1 year ago

946796fc

ggml-cuda : remove some superfluous comments for TQ2_0 tile loading

compilade committed 1 year ago

f5fddb6d

Merge branch 'master' into compilade/cuda-tq2_0

compilade committed 1 year ago

983aa09b

ggml-cuda : cleanup TQ2_0

compilade committed 1 year ago

fb43d5e8

doc: add cuda guide for fedora (#11135)

teihome committed 1 year ago

Verified 1204f972

server : add tooltips to settings and themes btn (#11154)

danbev committed 1 year ago

Verified 8eceb888

model: Add support for PhiMoE arch (#11003)

phymbert committed 1 year ago

Verified f8feb4b0

media : remove old img [no ci]

ggerganov committed 1 year ago

Verified be0e950c

llama-chat : add phi 4 template (#11148)

ngxson committed 1 year ago

Verified d9feae1c

fix: add missing msg in static_assert (#11143)

hydai committed 1 year ago

Verified 8d59d911

gguf-py : move scripts directory (#11116)

VJHack committed 1 year ago

Verified 8a1d9c25

Enhance user input handling for llama-run (#11138)

ericcurtin committed 1 year ago

Verified 1bf839b1

ci : use actions from ggml-org (#11140)

ngxson committed 1 year ago

Verified f7cd1330

lora : improve compat with `mergekit-extract-lora` (#11131)

ngxson committed 1 year ago

Verified 4d2b3d88

llama : avoid hardcoded QK_K (#11061)

ggerganov committed 1 year ago

Verified c07d437b

ggerganov committed 1 year ago

Verified 99a3755a

ggml : allow loading backend with env variable (ggml/1059)

rgerganov committed 1 year ago

Verified c792dcf4

ci : pin dependency to specific version (#11137)

ngxson committed 1 year ago

Verified 80ccf5d7

arg : option to exclude arguments from specific examples (#11136)

ggerganov committed 1 year ago

Verified a3c1232c

llamafile : ppc64le MMA INT8 implementation (#10912)

amritahs-ibm committed 1 year ago

Verified 8cef75c7

ci : fix cmake option (#11125)

ggerganov committed 1 year ago

Verified 0d52a69e

Disable GL_KHR_cooperative_matrix Vulkan extension if not available. (#11117)

mbaudier committed 1 year ago

Verified 02f04301

fix: Vulkan shader gen binary path when Cross-compiling (#11096)

ag2s20150909 committed 1 year ago

Verified bec2183f

GGUF: C++ refactor, backend support, misc fixes (#11030)

JohannesGaessler committed 1 year ago

Verified 53ff6b9b

ggml-backend : only offload from host buffers (fix) (#11124)

slaren committed 1 year ago

Verified 017cc5f4

ggml-backend : only offload from host buffers (#11120)

slaren committed 1 year ago

Verified a3d50bc0

rpc : code cleanup (#11107)

rgerganov committed 1 year ago

Verified a4dd4900

SYCL: Use get_multi_ptr instead of deprecated get_pointer in wkv6 (#11087)

qnixsynapse committed 1 year ago

Verified c0d6f790

Older