ngxson/llama.cpp

Pull Requests Commits

fix qwen2vl norm (2)

ngxson committed 272 days ago

37e24b14

qwen2vl does not use RMS norm

ngxson committed 272 days ago

56b41aff

Merge branch 'master' into xsn/mtmd_graph_builder_refactor

ngxson committed 272 days ago

4947b81d

also support tinygemma3 test model

ngxson committed 272 days ago

9eb496b4

SYCL: Disable reorder optimize by default and stop setting tensor extras when optimize is disabled (#13254)

qnixsynapse committed 272 days ago

Verified 1e333d5b

add comment for batch_size

ngxson committed 273 days ago

b69401e2

llama : fix build_ffn without gate (#13336)

ngxson committed 273 days ago

Verified 2f54e348

CUDA: fix bad asserts for partial offload (#13337)

JohannesGaessler committed 273 days ago

Verified 2356fb1d

fix windows build

ngxson committed 273 days ago

b429d0fa

use build_attn for minicpm resampler

ngxson committed 273 days ago

a155166b

move max_feature_layer to build_llava

ngxson committed 273 days ago

e16e3972

move minicpmv to a dedicated build function

ngxson committed 273 days ago

47517a11

convert : qwen2/3moe : set yarn metadata if present (#13331)

CISC committed 273 days ago

Verified 764b8562

pixtral migrated

ngxson committed 273 days ago

52f63454

CUDA: fix --split-mode row for MMQ (#13323)

JohannesGaessler committed 273 days ago

Verified 15a28ec8

gguf-py : avoid requiring pyside6 for other scripts (#13036)

compilade committed 273 days ago

Verified a7366faa

clean up siglip cgraph

ngxson committed 273 days ago

2c6f6727

CUDA: fix logic for clearing padding with -ngl 0 (#13320)

JohannesGaessler committed 273 days ago

Verified 90703650

sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264)

oobabooga committed 273 days ago

Verified 233461f8

ngxson committed 273 days ago

ba3f5463

mtmd : refactor graph builder

ngxson committed 273 days ago

bfd57944

server : Webui - change setText command from parent window to also send the message. (#13309)

igardev committed 273 days ago

Verified b34c8591

mtmd : rename llava directory to mtmd (#13311)

ngxson committed 273 days ago

Verified 9b61acf0

clip : fix confused naming ffn_up and ffn_down (#13290)

ngxson committed 274 days ago

Verified 5215b91e

convert : bailingmoe : set yarn metadata if present (#13312)

CISC committed 274 days ago

Verified ae803bfc

SYCL: Disable mul_mat kernels for noncontiguous tensor b (#13308)

qnixsynapse committed 274 days ago

Verified 66645a52

mtmd : add C public API (#13184)

ngxson committed 274 days ago

Verified 27aa2595

rpc : use backend registry, support dl backends (#13304)

slaren committed 274 days ago

Verified 9fdfcdae

ggml : activate s390x simd for Q3_K (#13301)

taronaeo committed 274 days ago

Verified 6eb7d25c

llava/mtmd : fixes to fully support dl backends (#13303)

slaren committed 274 days ago

Verified 86bd60d3

Older