ggerganov/llama.cpp

Pull Requests Commits

llama : remove logits_all flag + reorder llama_context_params

ggerganov committed 132 days ago

Verified 6107303a

context : remove logits_all flag

ggerganov committed 132 days ago

Verified 6c0501ad

sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343)

Alcpz committed 133 days ago

Verified 8733e0cf

docker : disable arm64 and intel images (#13356)

slaren committed 133 days ago

Verified 814f795e

ggerganov committed 133 days ago

d8794338

whisper: remove MSVC warnings pragmas (whisper/3090)

danbev committed 133 days ago

13b0a045

cmake : removed stdc++fs (whisper/3097)

JaredTweed committed 133 days ago

bba9d945

llama : deci : support ffn-free with attention (#13296)

CISC committed 133 days ago

Verified bc4e1128

common : Add a warning when we can't match samplers from a string or char. (#13330)

ycros committed 134 days ago

Verified 39e73ae0

cuda : remove nrows_x in mul_mat_q_process_tile (#13325)

yeahdongcn committed 134 days ago

Verified 1f73301b

examples : remove infill (#13283)

ggerganov committed 134 days ago

Verified 4773d7a0

llama : support tie embedding for chatglm models (#13328)

piDack committed 134 days ago

Verified 6c7fd67b

CUDA: mix virt/real CUDA archs for GGML_NATIVE=OFF (#13135)

JohannesGaessler committed 134 days ago

Verified 141a908a

clip : refactor graph builder (#13321)

ngxson committed 134 days ago

Verified 32916a49

sampling : make top_n_sigma no-op at <=0 or a single candidate (#13345)

DocShotgun committed 134 days ago

Verified ffc72720

sampling : don't consider -infinity values in top_n_sigma (#13344)

oobabooga committed 134 days ago

Verified 91a86a6f

cmake : remove arm64 msvc presets (#13342)

slaren committed 134 days ago

Verified f4ed10b6

SYCL: Disable reorder optimize by default and stop setting tensor extras when optimize is disabled (#13254)

qnixsynapse committed 134 days ago

Verified 1e333d5b

llama : fix build_ffn without gate (#13336)

ngxson committed 134 days ago

Verified 2f54e348

CUDA: fix bad asserts for partial offload (#13337)

JohannesGaessler committed 134 days ago

Verified 2356fb1d

convert : qwen2/3moe : set yarn metadata if present (#13331)

CISC committed 135 days ago

Verified 764b8562

CUDA: fix --split-mode row for MMQ (#13323)

JohannesGaessler committed 135 days ago

Verified 15a28ec8

gguf-py : avoid requiring pyside6 for other scripts (#13036)

compilade committed 135 days ago

Verified a7366faa

CUDA: fix logic for clearing padding with -ngl 0 (#13320)

JohannesGaessler committed 135 days ago

Verified 90703650

sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264)

oobabooga committed 135 days ago

Verified 233461f8

server : Webui - change setText command from parent window to also send the message. (#13309)

igardev committed 135 days ago

Verified b34c8591

mtmd : rename llava directory to mtmd (#13311)

ngxson committed 135 days ago

Verified 9b61acf0

clip : fix confused naming ffn_up and ffn_down (#13290)

ngxson committed 135 days ago

Verified 5215b91e

convert : bailingmoe : set yarn metadata if present (#13312)

CISC committed 135 days ago

Verified ae803bfc

SYCL: Disable mul_mat kernels for noncontiguous tensor b (#13308)

qnixsynapse committed 136 days ago

Verified 66645a52

Older