ggerganov/llama.cpp

Pull Requests Commits

gguf-py : fix flake8 lint

compilade committed 40 days ago

da140da7

gguf-py : support lazy tensor splitting

compilade committed 40 days ago

6cbbd8e1

llama : Support llama 4 text-only (#12791)

ngxson committed 40 days ago

Verified 1466621e

opencl: better identify Adreno GPU (#12760)

lhez committed 40 days ago

Verified 82974011

hellaswag: display estimated score confidence interval (#12797)

stduhpf committed 40 days ago

Verified 4ccea213

cuda : fix HIP and MUSA BF16 (#0)

ggerganov committed 40 days ago

1a1ab7e7

ggerganov committed 40 days ago

a4e46e28

ggml : simplify Arm fp16 CPU logic (ggml/1177)

ggerganov committed 40 days ago

ff067dbc

CUDA: don't convert BF16 weights to FP32 (ggml/1174)

CISC committed 40 days ago

36ca8b36

cpu: move all the operators into a separate c++ file (except mul_mat) (ggml/1167)

cmdr2 committed 40 days ago

995083e4

sycl: remove redundant memcopy in function ggml_backend_sycl_buffer_set_tensor (#12734)

zhouwg committed 40 days ago

Verified 518a0148

ci : no curl on ggml-ci (#12796)

ngxson committed 40 days ago

Verified e391d3ee

cmake : enable curl by default (#12761)

ngxson committed 40 days ago

Verified bd3f59f8

CANN: fix typo in ggml-cann (#12733)

zhouwg committed 40 days ago

Verified 52b3d71f

CANN: Refactor to reduce duplicate code (#12731)

hipudding committed 41 days ago

Verified d0d5b223

musa: fix compilation warnings in mp_22/31 (#12780)

yeahdongcn committed 41 days ago

Verified 916c83bf

vulkan: fix NaN issue in flash attention shader (#12776)

jeffbolznv committed 42 days ago

Verified 0c74b043

vulkan: Use unclamped loads for flash attention mask (#12720)

jeffbolznv committed 42 days ago

Verified 80b717d4

Vulkan: Tune Vulkan mmq int dot shader for performance (#12767)

0cc4m committed 42 days ago

Verified 6bf28f01

common : fix includes in arg.cpp and gemma3-cli.cpp (#12766)

barracuda156 committed 42 days ago

Verified f1e3eb42

clip : refactor clip_init, add tests (#12757)

ngxson committed 42 days ago

Verified 0364178c

common: custom hf endpoint support (#12769)

eternaphia committed 42 days ago

Verified c6ff5d2a

sync: minja (#12739)

ochafik committed 43 days ago

Verified 7a84777f

kv-cache : simplify + fix warning for recurrent models (#12756)

ggerganov committed 43 days ago

Verified 3e1d2934

ci: add Linux cross-compile build (#12428)

bandoti committed 43 days ago

Verified 1be76e46

server : webui : Upgrade daisyui, tailwindcss. (#12735)

nauful committed 43 days ago

Verified b7723942

gguf-split : --merge now respects --dry-run option (#12681)

nickhuang99 committed 43 days ago

Verified 23106f94

sycl: allow ggml-sycl configuration and compilation using Visual Studio project/solution (#12625)

s-Nick committed 43 days ago

Verified 94148ba3

cmake: fix ggml-shaders-gen compiler paths containing spaces (#12747)

hydroo committed 43 days ago

Verified 9ac4d611

docs : add XCFramework section to README.md [no ci] (#12746)

danbev committed 44 days ago

Verified 348888e0

Older