ggml-org/llama.cpp

Pull Requests Commits

metal : add memory pool for temp allocs (#12850)

ggerganov committed 237 days ago

Verified 7b53389c

llava : update documentations (#13055)

ngxson committed 238 days ago

Verified 24345353

ggml : add SSE 4.2 and x64 base variant for CPUs without AVX (#12871)

slaren committed 238 days ago

Verified 1d735c0b

SYCL: Add non-contiguous support in ROPE (#12993)

qnixsynapse committed 238 days ago

Verified 5368ddda

mtmd : merge llava, gemma3 and minicpmv CLI into single `llama-mtmd-cli` (#13012)

ngxson committed 238 days ago

Verified 84a9bf2f

convert : experimental support for `--mmproj` flag (#13023)

ngxson committed 239 days ago

Verified 2016f07b

llava: fix errors in clip.h on certain compilers (#13030)

jmorganca committed 239 days ago

Verified 66023048

vulkan: support noncontiguous rms_norm (#13031)

jeffbolznv committed 240 days ago

Verified 66168204

metal: add neg operator (#13029)

jmorganca committed 240 days ago

Verified 4ba9d711

Disable CI cross-compile builds (#13022)

bandoti committed 240 days ago

Verified 00137157

gguf-py : fix upload python package workflow (#13020)

CISC committed 240 days ago

Verified fb28f4f8

clip : refactor, add `image_manipulation` and `llava_uhd` classes (#13011)

ngxson committed 241 days ago

Verified 37b9f0d2

main : Fix Ctrl+D/newline handling (#12951)

danielzgtg committed 241 days ago

Verified 64082100

gguf-py : GGUF Editor GUI - Python + Qt6 (#12930)

christopherthompson81 committed 241 days ago

Verified aff9d107

server : use std::move whenever possible (#12936)

ngxson committed 241 days ago

Verified 35370ba9

SYCL: Refactor and enable FP16 in binary broadcast OPs (#12975)

qnixsynapse committed 241 days ago

Verified 8d660057

mtmd : add methods to access `mtmd_image_tokens` (#12906)

ngxson committed 242 days ago

Verified b9154ecf

rpc : add RPC_CMD_HELLO (#12955)

rgerganov committed 242 days ago

Verified 2db9ba14

graph : make FA compatible with MLA + add initial Metal kernels (#12953)

ggerganov committed 242 days ago

Verified 2f74c354

ggml: Re-enable CUDA graphs in presence of CONT and DUP nodes (#12970)

agray3 committed 242 days ago

Verified 207c22ec

CANN: Add support for async operator submission (#12864)

hipudding committed 242 days ago

Verified 7a395f67

llama : recognize IBM Granite 3.3 FIM tokens (#12988)

Noeda committed 243 days ago

Verified 971f245b

opencl: fix incorrect local_size index in profiling log (#12868)

kimminsu38oo committed 243 days ago

Verified 12b17501

vulkan: enable coopmat2 FA gqa and split_k optimizations more often (#12931)

jeffbolznv committed 243 days ago

Verified 015022bb

CANN: Add 310P operator support check (#12962)

noemotiovon committed 244 days ago

Verified b43d89e3

opencl: split `ggml-opencl.cl` into multiple files and cleanup (#12886)

lhez committed 244 days ago

Verified 80f19b41

metal : add FA-vec kernels for head size 96 (#12952)

ggerganov committed 244 days ago

Verified f8f820cc

CANN: Add x86 build ci (#12950)

hipudding committed 244 days ago

Verified 54a72720

CUDA/HIP: Share the same unified memory allocation logic. (#12934)

hjc4869 committed 245 days ago

Verified 84778e97

SYCL: Add ROPE vision kernel (#12887)

qnixsynapse committed 245 days ago

Verified 51067647

Newer Older