ochafik/llama.cpp

Pull Requests Commits

`server`: fix format of streamed tool call deltas (diff name, fix id location) (#13800)

ochafik committed 1 year ago

Verified d74e94c1

server: fix regression on streamed non-chat completion w/ stops (#13785)

ochafik committed 1 year ago

Verified f13847cf

examples : allow extracting embeddings from decoder contexts (#13797)

ggerganov committed 1 year ago

Verified 79c137f7

llama : clarify deprecation message (#13794)

ggerganov committed 1 year ago

Verified 22229314

sycl: Add more debug prints (#13640)

Rbiessy committed 1 year ago

Verified 9012eb9b

vulkan: mark IM2COL as supporting non-contig (#13783)

jeffbolznv committed 1 year ago

Verified fef693dc

CANN: Add the basic supports of Flash Attention kernel (#13627)

shibizhao committed 1 year ago

Verified 2d38b6e4

`server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771)

ochafik committed 1 year ago

Verified e121edc4

webui : bump max upload file size to 500MB (#13779)

ngxson committed 1 year ago

Verified 2f099b51

tests : improve UGM tokenizer test coverage (#13773)

CISC committed 1 year ago

Verified aa50ba46

kv-cache : rework kv_cell (#13706)

ggerganov committed 1 year ago

Verified de2ef53a

rpc : Fix build on OpenBSD (#13541)

percypiper committed 1 year ago

Verified c508256d

mtmd : add support for Qwen2-Audio and SeaLLM-Audio (#13760)

ngxson committed 1 year ago

Verified 40aaa8a4

docs : add Moondream2 pre-quantized link (#13745)

ddpasa committed 1 year ago

Verified a08c1d28

server: fix/test add_generation_prompt (#13770)

ochafik committed 1 year ago

Verified d785f9c1

llama : add support for Qwen3 MoE tied word embeddings (#13768)

estibi committed 1 year ago

Verified 4032ca40

SYCL: revert "sycl: simplify bin_bcast_kernel (#13383)" (#13752)

qnixsynapse committed 1 year ago

Verified 515fdbf7

`server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)

ochafik committed 1 year ago

Verified f5cd27b7

releases : bundle llvm omp library in windows release (#13763)

slaren committed 1 year ago

Verified a2d02d57

releases : enable openmp in windows cpu backend build (#13756)

slaren committed 1 year ago

Verified 17fc817b

ggml-cpu : set openmp wait time if not set (#13758)

slaren committed 1 year ago

Verified 2bd1b30f

Move GLM4 f32 attention fix to the correct function (#13750)

0cc4m committed 1 year ago

Verified 259469c4

ggml : add ggml_gelu_erf() CUDA kernel (#13719)

ngxson committed 1 year ago

Verified 4c32832c

vocab : fix ugm tokenizer precision (#13743)

CISC committed 1 year ago

Verified c3a26243

CUDA: fix race condition in FA vector kernels (#13742)

JohannesGaessler committed 1 year ago

Verified ffd0eae6

ci : enable winget package updates (#13734)

slaren committed 1 year ago

Verified b775345d

ci : add winget package updater (#13732)

slaren committed 1 year ago

Verified a70a8a69

hparams : initialize arrays (#13728)

ggerganov committed 1 year ago

Verified d13d0f61

llama : allow custom list of swa_layers (#13726)

ngxson committed 1 year ago

Verified 8a2afb75

server : support audio input (#13714)

ngxson committed 1 year ago

Verified 9ecf3e66

Newer Older