ngxson/llama.cpp

Pull Requests Commits

server : PoC implementation of "interim" server

ngxson committed 247 days ago

a3eb12f5

rpc : add rpc_msg_set_tensor_hash_req (#13353)

rgerganov committed 247 days ago

Verified b486ba05

vulkan: Allow up to 4096 elements for mul_mat_id row_ids (#13326)

jeffbolznv committed 247 days ago

Verified 02115dcd

server : (webui) rename has_multimodal --> modalities (#13393)

ngxson committed 247 days ago

Verified d9c4acca

ci : limit write permission to only the release step + fixes (#13392)

slaren committed 247 days ago

Verified 15e03282

mtmd : Expose helper_decode_image_chunk (#13366)

mattjcly committed 248 days ago

Verified f05a6d71

server : (webui) fix a very small misalignment (#13387)

ngxson committed 248 days ago

Verified ee01d71e

server : (webui) revamp the input area, plus many small UI improvements (#13365)

ngxson committed 248 days ago

Verified 8c83449c

convert : support rope_scaling type and rope_type (#13349)

CISC committed 248 days ago

Verified 1a844be1

mtmd : fix the calculation of n_tokens for smolvlm (#13381)

awkrail committed 248 days ago

Verified 0ccc1213

context : allow cache-less context for embeddings (#13108)

ggerganov committed 248 days ago

Verified 6562e5a4

context : remove logits_all flag (#13284)

ggerganov committed 248 days ago

Verified 51fb96b1

ci : move release workflow to a separate file (#13362)

slaren committed 248 days ago

Verified 70a6991e

llama : print size and type of overridden tensors (#13364)

slaren committed 248 days ago

Verified f0610212

sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343)

Alberto Cabrera Pérez committed 248 days ago

Verified 8733e0cf

docker : disable arm64 and intel images (#13356)

slaren committed 249 days ago

Verified 814f795e

ggerganov committed 249 days ago

d8794338

whisper: remove MSVC warnings pragmas (whisper/3090)

danbev committed 249 days ago

13b0a045

cmake : removed stdc++fs (whisper/3097)

JaredTweed committed 249 days ago

bba9d945

llama : deci : support ffn-free with attention (#13296)

CISC committed 249 days ago

Verified bc4e1128

common : Add a warning when we can't match samplers from a string or char. (#13330)

ycros committed 249 days ago

Verified 39e73ae0

cuda : remove nrows_x in mul_mat_q_process_tile (#13325)

yeahdongcn committed 249 days ago

Verified 1f73301b

examples : remove infill (#13283)

ggerganov committed 249 days ago

Verified 4773d7a0

llama : support tie embedding for chatglm models (#13328)

piDack committed 249 days ago

Verified 6c7fd67b

CUDA: mix virt/real CUDA archs for GGML_NATIVE=OFF (#13135)

JohannesGaessler committed 249 days ago

Verified 141a908a

clip : refactor graph builder (#13321)

ngxson committed 249 days ago

Verified 32916a49

sampling : make top_n_sigma no-op at <=0 or a single candidate (#13345)

DocShotgun committed 249 days ago

Verified ffc72720

sampling : don't consider -infinity values in top_n_sigma (#13344)

oobabooga committed 250 days ago

Verified 91a86a6f

cmake : remove arm64 msvc presets (#13342)

slaren committed 250 days ago

Verified f4ed10b6

SYCL: Disable reorder optimize by default and stop setting tensor extras when optimize is disabled (#13254)

qnixsynapse committed 250 days ago

Verified 1e333d5b

Older