ngxson/llama.cpp

Pull Requests Commits

fix qwen2vl norm (2)

ngxson committed 1 year ago

37e24b14

qwen2vl does not use RMS norm

ngxson committed 1 year ago

56b41aff

Merge branch 'master' into xsn/mtmd_graph_builder_refactor

ngxson committed 1 year ago

4947b81d

also support tinygemma3 test model

ngxson committed 1 year ago

9eb496b4

SYCL: Disable reorder optimize by default and stop setting tensor extras when optimize is disabled (#13254)

qnixsynapse committed 1 year ago

Verified 1e333d5b

add comment for batch_size

ngxson committed 1 year ago

b69401e2

llama : fix build_ffn without gate (#13336)

ngxson committed 1 year ago

Verified 2f54e348

CUDA: fix bad asserts for partial offload (#13337)

JohannesGaessler committed 1 year ago

Verified 2356fb1d

fix windows build

ngxson committed 1 year ago

b429d0fa

use build_attn for minicpm resampler

ngxson committed 1 year ago

a155166b

move max_feature_layer to build_llava

ngxson committed 1 year ago

e16e3972

move minicpmv to a dedicated build function

ngxson committed 1 year ago

47517a11

convert : qwen2/3moe : set yarn metadata if present (#13331)

CISC committed 1 year ago

Verified 764b8562

pixtral migrated

ngxson committed 1 year ago

52f63454

CUDA: fix --split-mode row for MMQ (#13323)

JohannesGaessler committed 1 year ago

Verified 15a28ec8

gguf-py : avoid requiring pyside6 for other scripts (#13036)

compilade committed 1 year ago

Verified a7366faa

clean up siglip cgraph

ngxson committed 1 year ago

2c6f6727

CUDA: fix logic for clearing padding with -ngl 0 (#13320)

JohannesGaessler committed 1 year ago

Verified 90703650

sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264)

oobabooga committed 1 year ago

Verified 233461f8

ngxson committed 1 year ago

ba3f5463

mtmd : refactor graph builder

ngxson committed 1 year ago

bfd57944

server : Webui - change setText command from parent window to also send the message. (#13309)

igardev committed 1 year ago

Verified b34c8591

mtmd : rename llava directory to mtmd (#13311)

ngxson committed 1 year ago

Verified 9b61acf0

clip : fix confused naming ffn_up and ffn_down (#13290)

ngxson committed 1 year ago

Verified 5215b91e

convert : bailingmoe : set yarn metadata if present (#13312)

CISC committed 1 year ago

Verified ae803bfc

SYCL: Disable mul_mat kernels for noncontiguous tensor b (#13308)

qnixsynapse committed 1 year ago

Verified 66645a52

mtmd : add C public API (#13184)

ngxson committed 1 year ago

Verified 27aa2595

rpc : use backend registry, support dl backends (#13304)

slaren committed 1 year ago

Verified 9fdfcdae

ggml : activate s390x simd for Q3_K (#13301)

taronaeo committed 1 year ago

Verified 6eb7d25c

llava/mtmd : fixes to fully support dl backends (#13303)

slaren committed 1 year ago

Verified 86bd60d3

Older