ngxson/llama.cpp

Pull Requests Commits

Apply suggestions from code review

ngxson committed 1 year ago

Verified 962805bf

ngxson committed 1 year ago

6e522eca

ggml : add ggml_fill()

ngxson committed 1 year ago

f44c1773

llama : add support for Qwen3 MoE tied word embeddings (#13768)

estibi committed 1 year ago

Verified 4032ca40

SYCL: revert "sycl: simplify bin_bcast_kernel (#13383)" (#13752)

qnixsynapse committed 1 year ago

Verified 515fdbf7

`server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)

ochafik committed 1 year ago

Verified f5cd27b7

releases : bundle llvm omp library in windows release (#13763)

slaren committed 1 year ago

Verified a2d02d57

releases : enable openmp in windows cpu backend build (#13756)

slaren committed 1 year ago

Verified 17fc817b

ggml-cpu : set openmp wait time if not set (#13758)

slaren committed 1 year ago

Verified 2bd1b30f

Move GLM4 f32 attention fix to the correct function (#13750)

0cc4m committed 1 year ago

Verified 259469c4

ggml : add ggml_gelu_erf() CUDA kernel (#13719)

ngxson committed 1 year ago

Verified 4c32832c

vocab : fix ugm tokenizer precision (#13743)

CISC committed 1 year ago

Verified c3a26243

CUDA: fix race condition in FA vector kernels (#13742)

JohannesGaessler committed 1 year ago

Verified ffd0eae6

ci : enable winget package updates (#13734)

slaren committed 1 year ago

Verified b775345d

ci : add winget package updater (#13732)

slaren committed 1 year ago

Verified a70a8a69

hparams : initialize arrays (#13728)

ggerganov committed 1 year ago

Verified d13d0f61

llama : allow custom list of swa_layers (#13726)

ngxson committed 1 year ago

Verified 8a2afb75

server : support audio input (#13714)

ngxson committed 1 year ago

Verified 9ecf3e66

CANN: Support MUL_MAT_ID for q8_0 and q4_0 (#13705)

noemotiovon committed 1 year ago

Verified faaaff5f

ggml : fix the order of ggml_unary_op (#13718)

ngxson committed 1 year ago

Verified e16c4731

vulkan: support CPY from any type to itself (#13695)

jeffbolznv committed 1 year ago

Verified 1dcd0196

vulkan: Disable coopmat/coopmat2/bfloat extensions if glslc doesn't support it (#13696)

jeffbolznv committed 1 year ago

Verified c10ed6cb

use LOG_WARN to replace `std::cerr` (#13657)

foldl committed 1 year ago

Verified a127ff17

release : fix windows hip release (#13707)

slaren committed 1 year ago

Verified 3079e9ac

tts : fix n_ubatch + make WavTokenizer cache-less (#13713)

ggerganov committed 1 year ago

Verified 8a1d206f

mtmd : add ultravox audio input (#13623)

ngxson committed 1 year ago

Verified 797990c4

common: Include torch package for s390x (#13699)

taronaeo committed 1 year ago

Verified ab863357

server : pad small embedding batches (#13692)

ggerganov committed 1 year ago

Verified cc74d5be

gguf-py : correct charsmap parameter typing (#13701)

CISC committed 1 year ago

Verified 5be24af7

sycl : Remove waits from function calls (#13702)

s-Nick committed 1 year ago

Verified d394a9ae

Older