ochafik/llama.cpp

Pull Requests Commits

Add (slow) server test for completion + stream + stop

ochafik committed 312 days ago

98982bdf

more forgiving message diffs: partial stop words aren't erased, full stops are

ochafik committed 312 days ago

e8f6e335

server: fix/test add_generation_prompt (#13770)

ochafik committed 313 days ago

Verified d785f9c1

llama : add support for Qwen3 MoE tied word embeddings (#13768)

estibi committed 313 days ago

Verified 4032ca40

SYCL: revert "sycl: simplify bin_bcast_kernel (#13383)" (#13752)

qnixsynapse committed 313 days ago

Verified 515fdbf7

`server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)

ochafik committed 313 days ago

Verified f5cd27b7

releases : bundle llvm omp library in windows release (#13763)

slaren committed 313 days ago

Verified a2d02d57

releases : enable openmp in windows cpu backend build (#13756)

slaren committed 313 days ago

Verified 17fc817b

ggml-cpu : set openmp wait time if not set (#13758)

slaren committed 313 days ago

Verified 2bd1b30f

Move GLM4 f32 attention fix to the correct function (#13750)

0cc4m committed 314 days ago

Verified 259469c4

ggml : add ggml_gelu_erf() CUDA kernel (#13719)

ngxson committed 314 days ago

Verified 4c32832c

vocab : fix ugm tokenizer precision (#13743)

CISC committed 314 days ago

Verified c3a26243

CUDA: fix race condition in FA vector kernels (#13742)

JohannesGaessler committed 314 days ago

Verified ffd0eae6

ci : enable winget package updates (#13734)

slaren committed 314 days ago

Verified b775345d

ci : add winget package updater (#13732)

slaren committed 314 days ago

Verified a70a8a69

hparams : initialize arrays (#13728)

ggerganov committed 315 days ago

Verified d13d0f61

llama : allow custom list of swa_layers (#13726)

ngxson committed 315 days ago

Verified 8a2afb75

server : support audio input (#13714)

ngxson committed 315 days ago

Verified 9ecf3e66

CANN: Support MUL_MAT_ID for q8_0 and q4_0 (#13705)

noemotiovon committed 315 days ago

Verified faaaff5f

ggml : fix the order of ggml_unary_op (#13718)

ngxson committed 315 days ago

Verified e16c4731

vulkan: support CPY from any type to itself (#13695)

jeffbolznv committed 315 days ago

Verified 1dcd0196

vulkan: Disable coopmat/coopmat2/bfloat extensions if glslc doesn't support it (#13696)

jeffbolznv committed 315 days ago

Verified c10ed6cb

use LOG_WARN to replace `std::cerr` (#13657)

foldl committed 315 days ago

Verified a127ff17

release : fix windows hip release (#13707)

slaren committed 315 days ago

Verified 3079e9ac

tts : fix n_ubatch + make WavTokenizer cache-less (#13713)

ggerganov committed 315 days ago

Verified 8a1d206f

mtmd : add ultravox audio input (#13623)

ngxson committed 315 days ago

Verified 797990c4

common: Include torch package for s390x (#13699)

taronaeo committed 315 days ago

Verified ab863357

server : pad small embedding batches (#13692)

ggerganov committed 316 days ago

Verified cc74d5be

gguf-py : correct charsmap parameter typing (#13701)

CISC committed 316 days ago

Verified 5be24af7

sycl : Remove waits from function calls (#13702)

s-Nick committed 316 days ago

Verified d394a9ae

Older