ggerganov/llama.cpp

Pull Requests Commits

ggml : riscv: add xtheadvector support (#13720)

xctan committed 1 year ago

Verified 05f6ac62

mtmd : support Qwen 2.5 Omni (input audio+vision, no audio output) (#13784)

ngxson committed 1 year ago

Verified bc583e3c

docs: remove link for llama-cli function calling (#13810)

mtmcp committed 1 year ago

Verified 72b090da

ggml-cpu: x86 feature detection is specific to x86 (#13811)

ckastner committed 1 year ago

Verified 7fe03e74

ggml : allow CUDA graphs when using pipeline parallelism (#13814)

slaren committed 1 year ago

Verified 952f3953

kv-cells : track min/max used cells and per-sequence positions (#13808)

ggerganov committed 1 year ago

Verified 81713121

sampling : make sure samplers return at least 1 token (#13822)

ggerganov committed 1 year ago

Verified f9cd6839

llama : validate seq id batch input (#13809)

ggerganov committed 1 year ago

Verified 4f81b33e

server: --offline mode (#13804)

ochafik committed 1 year ago

Verified cdf94a18

scripts : add option to compare commits in Debug (#13806)

ggerganov committed 1 year ago

Verified a26c4cc1

cuda : avoid cuGetErrorString (#13791)

ggerganov committed 1 year ago

Verified 4265a87b

SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611)

qnixsynapse committed 1 year ago

Verified 6f180b91

server: fix streaming crashes (#13786)

ochafik committed 1 year ago

Verified 03f582ae

examples/training: Fix file name in README (#13803)

standby24x7 committed 1 year ago

Verified 88c125f2

`server`: fix format of streamed tool call deltas (diff name, fix id location) (#13800)

ochafik committed 1 year ago

Verified d74e94c1

server: fix regression on streamed non-chat completion w/ stops (#13785)

ochafik committed 1 year ago

Verified f13847cf

examples : allow extracting embeddings from decoder contexts (#13797)

ggerganov committed 1 year ago

Verified 79c137f7

llama : clarify deprecation message (#13794)

ggerganov committed 1 year ago

Verified 22229314

sycl: Add more debug prints (#13640)

Rbiessy committed 1 year ago

Verified 9012eb9b

vulkan: mark IM2COL as supporting non-contig (#13783)

jeffbolznv committed 1 year ago

Verified fef693dc

CANN: Add the basic supports of Flash Attention kernel (#13627)

shibizhao committed 1 year ago

Verified 2d38b6e4

`server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771)

ochafik committed 1 year ago

Verified e121edc4

webui : bump max upload file size to 500MB (#13779)

ngxson committed 1 year ago

Verified 2f099b51

tests : improve UGM tokenizer test coverage (#13773)

CISC committed 1 year ago

Verified aa50ba46

kv-cache : rework kv_cell (#13706)

ggerganov committed 1 year ago

Verified de2ef53a

rpc : Fix build on OpenBSD (#13541)

percypiper committed 1 year ago

Verified c508256d

mtmd : add support for Qwen2-Audio and SeaLLM-Audio (#13760)

ngxson committed 1 year ago

Verified 40aaa8a4

docs : add Moondream2 pre-quantized link (#13745)

ddpasa committed 1 year ago

Verified a08c1d28

server: fix/test add_generation_prompt (#13770)

ochafik committed 1 year ago

Verified d785f9c1

llama : add support for Qwen3 MoE tied word embeddings (#13768)

estibi committed 1 year ago

Verified 4032ca40

Newer Older