ngxson/llama.cpp

Pull Requests Commits

ngxson committed 301 days ago

9ed430ca

ngxson committed 301 days ago

b8000fd5

update docs and hot topics

ngxson committed 301 days ago

5fe8d72c

adapt the new web ui

ngxson committed 301 days ago

f5fbc03e

Merge branch 'master' into xsn/server_mtmd

ngxson committed 301 days ago

abfd821d

handle_completions_impl returns void

ngxson committed 302 days ago

b2906a98

on prmpt processing done, assert cache_tokens.size

ngxson committed 302 days ago

689035cc

rm can_be_detokenized

ngxson committed 302 days ago

f10fc561

Apply suggestions from code review

ngxson committed 302 days ago

Verified 51afc0a2

metal : optimize MoE for large batches (#13388)

ggerganov committed 302 days ago

Verified 611aa914

CUDA: FA support for Deepseek (Ampere or newer) (#13306)

JohannesGaessler committed 302 days ago

Verified 0cf6725e

llama : do not crash if there is no CPU backend (#13395)

slaren committed 302 days ago

Verified 27ebfcac

CUDA: fix crash on large batch size for MoE models (#13384)

JohannesGaessler committed 302 days ago

Verified 5c86c9ed

imatrix : Add --parse-special for enabling parsing of special tokens in imatrix calculation (#13389)

bartowski1182 committed 302 days ago

Verified efb8b47e

llama-run: add support for downloading models from ModelScope (#13370)

yeahdongcn committed 302 days ago

Verified 0527771d

mtmd : fix batch_view for m-rope (#13397)

ngxson committed 302 days ago

Verified 2189fd3b

llama : one-off chat template fix for Mistral-Small-2503 (#13398)

ngxson committed 302 days ago

Verified 3f96aeff

rpc : add rpc_msg_set_tensor_hash_req (#13353)

rgerganov committed 302 days ago

Verified b486ba05

vulkan: Allow up to 4096 elements for mul_mat_id row_ids (#13326)

jeffbolznv committed 302 days ago

Verified 02115dcd

server : (webui) rename has_multimodal --> modalities (#13393)

ngxson committed 302 days ago

Verified d9c4acca

ci : limit write permission to only the release step + fixes (#13392)

slaren committed 302 days ago

Verified 15e03282

mtmd : Expose helper_decode_image_chunk (#13366)

mattjcly committed 302 days ago

Verified f05a6d71

server : (webui) fix a very small misalignment (#13387)

ngxson committed 302 days ago

Verified ee01d71e

Merge branch 'master' into xsn/server_mtmd

ngxson committed 302 days ago

72824563

server : (webui) revamp the input area, plus many small UI improvements (#13365)

ngxson committed 302 days ago

Verified 8c83449c

convert : support rope_scaling type and rope_type (#13349)

CISC committed 302 days ago

Verified 1a844be1

mtmd : fix the calculation of n_tokens for smolvlm (#13381)

awkrail committed 302 days ago

Verified 0ccc1213

context : allow cache-less context for embeddings (#13108)

ggerganov committed 303 days ago

Verified 6562e5a4

context : remove logits_all flag (#13284)

ggerganov committed 303 days ago

Verified 51fb96b1

speculative: use slot.cache_tokens.insert

ngxson committed 303 days ago

bef122e1

Older