ngxson/llama.cpp

Pull Requests Commits

ggml : add mrope kernel for metal

ngxson committed 1 year ago

82e156d2

Add `--no-op-offload` to improve `-ot` pp perf in MoE models like llama4 400B (#13386)

hjc4869 committed 1 year ago

Verified 7f323a58

mtmd : support InternVL 3 38B and 78B mmproj (#13443)

city96 committed 1 year ago

Verified 3eac2093

mtmd : move helpers to dedicated file (#13442)

ngxson committed 1 year ago

Verified a634d75d

docs : Fix typo in InternVL3 model name (#13440)

99991 committed 1 year ago

Verified 62d4250e

CUDA: fix race conditions FlashAttention kernels (#13438)

JohannesGaessler committed 1 year ago

Verified 0208355f

vocab : add ByteDance-Seed/Seed-Coder (#13423)

CISC committed 1 year ago

Verified d2a4ef05

mtmd : add hard limit on image resolution for qwen2vl / qwen2.5vl (#13434)

ngxson committed 1 year ago

Verified 15e6125a

server : update docs (#13432)

ngxson committed 1 year ago

Verified 3b24d26c

llguidance : set tokenizer slices to default (#13424)

CISC committed 1 year ago

Verified 43dfd741

ci: free_disk_space flag enabled for intel variant (#13426)

Thammachart committed 1 year ago

Verified b064a51a

mtmd : support InternVL 2.5 and 3 (#13422)

ngxson committed 1 year ago

Verified 053367d1

CUDA: fix FlashAttention on Turing (#13415)

JohannesGaessler committed 1 year ago

Verified d8919424

arg : add env var to control mmproj (#13416)

ngxson committed 1 year ago

Verified 7fef1176

vulkan: scalar flash attention implementation (#13324)

jeffbolznv committed 1 year ago

Verified dc1d2adf

chore(llguidance): use tagged version that does not break the build (#13413)

HRKings committed 1 year ago

Verified 7c28a74e

server : vision support via libmtmd (#12898)

ngxson committed 1 year ago

Verified 33eff402

sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (#12858)

Alberto Cabrera Pérez committed 1 year ago

Verified 17512a94

metal : optimize MoE for large batches (#13388)

ggerganov committed 1 year ago

Verified 611aa914

CUDA: FA support for Deepseek (Ampere or newer) (#13306)

JohannesGaessler committed 1 year ago

Verified 0cf6725e

llama : do not crash if there is no CPU backend (#13395)

slaren committed 1 year ago

Verified 27ebfcac

CUDA: fix crash on large batch size for MoE models (#13384)

JohannesGaessler committed 1 year ago

Verified 5c86c9ed

imatrix : Add --parse-special for enabling parsing of special tokens in imatrix calculation (#13389)

bartowski1182 committed 1 year ago

Verified efb8b47e

llama-run: add support for downloading models from ModelScope (#13370)

yeahdongcn committed 1 year ago

Verified 0527771d

mtmd : fix batch_view for m-rope (#13397)

ngxson committed 1 year ago

Verified 2189fd3b

llama : one-off chat template fix for Mistral-Small-2503 (#13398)

ngxson committed 1 year ago

Verified 3f96aeff

rpc : add rpc_msg_set_tensor_hash_req (#13353)

rgerganov committed 1 year ago

Verified b486ba05

vulkan: Allow up to 4096 elements for mul_mat_id row_ids (#13326)

jeffbolznv committed 1 year ago

Verified 02115dcd

server : (webui) rename has_multimodal --> modalities (#13393)

ngxson committed 1 year ago

Verified d9c4acca

ci : limit write permission to only the release step + fixes (#13392)

slaren committed 1 year ago

Verified 15e03282

Older