ngxson/llama.cpp

Pull Requests Commits

use add_rope_freq_base_swa

ngxson committed 49 days ago

0cd227fe

Merge branch 'master' into xsn/xiaomi_mimo_v2

ngxson committed 49 days ago

d6f45334

fit-params : fix race condition in fit-params output (#18276)

Aadeshveer committed 49 days ago

Verified c1842842

CUDA: experimental native mxfp4 support for blackwell (#17906)

am17an committed 49 days ago

Verified c8a2417d

model : support for LlamaBidirectionalModel architecture (#18220)

sfallah committed 49 days ago

Verified 54132f1b

vulkan: fix command buffer corruption in ggml_backend_vk_event_wait (#18302)

jeffbolznv committed 49 days ago

Verified 2a9ea202

ngxson committed 49 days ago

e4761261

Merge pull request #69 from Aaryan-Kapoor/pr-18328

ngxson committed 49 days ago

Verified 0f24c3b8

CANN : refactor ACL graph cache (#17752)

wangweixuan committed 49 days ago

Verified ce7a6dc0

docs: Fix typos in SYCL documentation (#18269)

yoka committed 49 days ago

Verified 1ce0126b

vulkan: use fewer FA rows for small cache runs (#18280)

0cc4m committed 49 days ago

Verified 7f459c98

CANN: Uses yarn_ramp cache in ROPE (#17725)

TianHao324 committed 49 days ago

Verified cf2ffc02

common: add `LLAMA_ARG_OVERRIDE_TENSOR` env var for `-ot` arg (#18267)

ddh0 committed 49 days ago

Verified 10355dc7

mimo2: wire RMS eps + MoE bias + converter guards

Aaryan-Kapoor committed 50 days ago

a5c54951

ngxson committed 50 days ago

d4a3c4d4

correct gating func

ngxson committed 50 days ago

3bf8f23c

somewhat working

ngxson committed 50 days ago

55584783

ngxson committed 50 days ago

237dfadf

server: return_progress to also report 0% processing state (#18305)

ngxson committed 50 days ago

Verified 5ee4e43f

add swa and per-layer n_head_kv

ngxson committed 50 days ago

db8afa6a

add_sliding_window_pattern

ngxson committed 50 days ago

09d3df9b

ngxson committed 50 days ago

4e810162

runnable not incorrect

ngxson committed 50 days ago

85937f90

ngxson committed 50 days ago

86e8d1f1

rename mimov2 --> mimo2

ngxson committed 50 days ago

bd806505

mimov2: convert ok

ngxson committed 50 days ago

eb2cee1b

webui: apply webui_settings on first load (#18223)

ServeurpersoCom committed 50 days ago

Verified 5b6c9bc0

server: fix crash with model not having BOS/EOS (#18321)

ngxson committed 50 days ago

Verified 849d0211

model-conversion : add device option to run-org-model.py (#18318)

danbev committed 50 days ago

Verified 8e3ead6e

rpc : add check for rpc buffer type (#18242)

struct committed 50 days ago

Verified 12ee1763

Older