ngxson/llama.cpp

Pull Requests Commits

minor style fix

ngxson committed 260 days ago

02195d51

split qwen2 and qwen2.5 code blocks

ngxson committed 261 days ago

a264a254

minicpmv : use clip_n_mmproj_embd instead of copying the same code everywhere

ngxson committed 261 days ago

ea24eb2e

more strict assert

ngxson committed 261 days ago

6bac190d

clip : refactor set input for cgraph

ngxson committed 261 days ago

2b8460b8

musa: fix build warning (#13129)

yeahdongcn committed 261 days ago

Verified e291450b

Fixes Qwen2.5VL segfault during inference with https://github.com/ggml-org/llama.cpp/pull/12402 as has_qwen2vl_merger migration was incomplete (#13133)

LostRuins committed 261 days ago

Verified 59e991c2

clip : Add Qwen2.5VL support (#12402)

HimariO committed 261 days ago

Verified ca2bb89e

common : add common_remote_get_content (#13123)

ngxson committed 262 days ago

Verified 2d451c80

clip : improve projector naming (#13118)

ngxson committed 262 days ago

Verified 4753791e

ggml: move fp16/bf16 conversion optimizations to CPU backend + export conversion APIs (#13107)

SongXiaoXi committed 262 days ago

Verified 77d5e9a7

grammar : handle maxItems == 0 in JSON schema (#13117)

rick-github committed 262 days ago

Verified d5fe4e81

llama : fix K-shift with quantized K and BLAS backend (#13113)

slaren committed 263 days ago

Verified 295354ea

Force FP32 compute in GLM4 FFN Down (#13101)

city96 committed 263 days ago

Verified 558a7647

clip : fix pixtral on some GPU backends (#13097)

ngxson committed 263 days ago

Verified edb18b6e

change the reorder tensor from init to execute OP (#13003)

NeoZhangJianyu committed 263 days ago

Verified 514c4560

rpc : do not wait for response when sending RPC_CMD_SET_TENSOR (#12943)

rgerganov committed 263 days ago

Verified 553a5c3a

clip : remove boi/eoi embeddings for GLM-edge model (#13081)

ngxson committed 264 days ago

Verified 13be08da

embeddings : fix batch sizes (#13076)

ggerganov committed 264 days ago

Verified 226251ed

ggml : fix trailing whitespaces (#0)

ggerganov committed 264 days ago

87616f06

ggerganov committed 264 days ago

63b49114

ggml : Depthwise 2D convolution (ggml/1152)

Acly committed 264 days ago

c6e8cc28

CUDA: use switch statements in constexpr functions (#13095)

JohannesGaessler committed 264 days ago

Verified b10d8bfd

cmake : do not include ./src as public for libllama (#13062)

ggerganov committed 264 days ago

Verified 13b45488

clang-tidy : disable warning about missing math parenthesis (#13091)

ggerganov committed 264 days ago

Verified 572b3141

arg : add --no-mmproj-offload (#13093)

ngxson committed 264 days ago

Verified 7c727fbe

arg : clean up handling --mmproj with -hf (#13082)

ngxson committed 264 days ago

Verified 80982e81

metal : fix floating-point range of attention scores in FA kernels (#13090)

ggerganov committed 264 days ago

Verified 7604a7d6

vulkan: matmul gcn tuning (#13016)

netrunnereve committed 264 days ago

Verified b3b6d862

llama-mtmd-cli: Sigint rework in mtmd vision example (#13080)

pl752 committed 265 days ago

Verified 56304069

Older