ggerganov/llama.cpp

Pull Requests Commits

Break down main function in llama-server

ericcurtin committed 8 days ago

5c32fc3d

CUDA: fix FlashAttention on Turing (#13415)

JohannesGaessler committed 8 days ago

Verified d8919424

arg : add env var to control mmproj (#13416)

ngxson committed 8 days ago

Verified 7fef1176

vulkan: scalar flash attention implementation (#13324)

jeffbolznv committed 8 days ago

Verified dc1d2adf

chore(llguidance): use tagged version that does not break the build (#13413)

HRKings committed 9 days ago

Verified 7c28a74e

server : vision support via libmtmd (#12898)

ngxson committed 9 days ago

Verified 33eff402

sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (#12858)

Alcpz committed 9 days ago

Verified 17512a94

metal : optimize MoE for large batches (#13388)

ggerganov committed 9 days ago

Verified 611aa914

CUDA: FA support for Deepseek (Ampere or newer) (#13306)

JohannesGaessler committed 9 days ago

Verified 0cf6725e

llama : do not crash if there is no CPU backend (#13395)

slaren committed 9 days ago

Verified 27ebfcac

CUDA: fix crash on large batch size for MoE models (#13384)

JohannesGaessler committed 9 days ago

Verified 5c86c9ed

imatrix : Add --parse-special for enabling parsing of special tokens in imatrix calculation (#13389)

bartowski1182 committed 9 days ago

Verified efb8b47e

llama-run: add support for downloading models from ModelScope (#13370)

yeahdongcn committed 9 days ago

Verified 0527771d

mtmd : fix batch_view for m-rope (#13397)

ngxson committed 9 days ago

Verified 2189fd3b

llama : one-off chat template fix for Mistral-Small-2503 (#13398)

ngxson committed 9 days ago

Verified 3f96aeff

rpc : add rpc_msg_set_tensor_hash_req (#13353)

rgerganov committed 9 days ago

Verified b486ba05

vulkan: Allow up to 4096 elements for mul_mat_id row_ids (#13326)

jeffbolznv committed 9 days ago

Verified 02115dcd

server : (webui) rename has_multimodal --> modalities (#13393)

ngxson committed 9 days ago

Verified d9c4acca

ci : limit write permission to only the release step + fixes (#13392)

slaren committed 9 days ago

Verified 15e03282

mtmd : Expose helper_decode_image_chunk (#13366)

mattjcly committed 10 days ago

Verified f05a6d71

server : (webui) fix a very small misalignment (#13387)

ngxson committed 10 days ago

Verified ee01d71e

server : (webui) revamp the input area, plus many small UI improvements (#13365)

ngxson committed 10 days ago

Verified 8c83449c

convert : support rope_scaling type and rope_type (#13349)

CISC committed 10 days ago

Verified 1a844be1

mtmd : fix the calculation of n_tokens for smolvlm (#13381)

awkrail committed 10 days ago

Verified 0ccc1213

context : allow cache-less context for embeddings (#13108)

ggerganov committed 10 days ago

Verified 6562e5a4

context : remove logits_all flag (#13284)

ggerganov committed 10 days ago

Verified 51fb96b1

ci : move release workflow to a separate file (#13362)

slaren committed 10 days ago

Verified 70a6991e

llama : print size and type of overridden tensors (#13364)

slaren committed 10 days ago

Verified f0610212

sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343)

Alcpz committed 10 days ago

Verified 8733e0cf

docker : disable arm64 and intel images (#13356)

slaren committed 11 days ago

Verified 814f795e

Older