ngxson/llama.cpp

Pull Requests Commits

ngxson committed 6 days ago

a4dd3c17

correct metal kernel

ngxson committed 6 days ago

11d1450b

revert changes to mistral3

ngxson committed 6 days ago

a0b02a9b

passed non-mrope

ngxson committed 6 days ago

a6407881

fix more broken cases

ngxson committed 6 days ago

509dfebe

ngxson committed 7 days ago

1affe19e

add test to compare old vs new rope

ngxson committed 7 days ago

334bee04

ngxson committed 7 days ago

0a470373

add metal kernel

ngxson committed 7 days ago

dd9c7e34

allow f32 as pos input

ngxson committed 7 days ago

d01b4552

ngxson committed 10 days ago

c69a94e9

ggml rope v2 demo

ngxson committed 10 days ago

5078cfed

metal: use shared buffers on eGPU (#17866)

jdemeule committed 10 days ago

Verified 165caaf5

mtmd: refactor audio preprocessing (#17978)

ngxson committed 11 days ago

Verified 96a181a9

cli: fixed dead links to tools/main for cli and completion, fixed code owners (#17993)

andrew-aladev committed 11 days ago

Verified 4a4f7e65

webui: add "delete all conversations" button to import/export tab (#17444)

thomasjfox committed 11 days ago

Verified e73d5486

llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)

JohannesGaessler committed 11 days ago

Verified b1f3a6e5

[SYCL] Support gpt-oss by OPs add-id, mul_mat for mxfp4, swiglu_oai (#17826)

NeoZhangJianyu committed 11 days ago

Verified 4aced7a6

model : add glm-asr support (#17901)

piDack committed 11 days ago

Verified 745fa0e7

preset: handle negated arg, reverse the meaning if needed (#18041)

ngxson committed 11 days ago

Verified 52392291

convert : refactor rope scaling handling (#18013)

CISC committed 11 days ago

Verified 5c8a7171

mtmd: enhance image resizing in llava_uhd (#18014)

bluebread committed 11 days ago

Verified 37f5a109

vulkan: fix mul_mat_vec_iq1_s formatting (#18026)

0cc4m committed 12 days ago

Verified 9e6649ec

graph: add f_attn_temp_offset (#18025)

ngxson committed 12 days ago

Verified 0759b09c

common : refactor common_sampler + grammar logic changes (#17937)

ggerganov committed 12 days ago

Verified 254098a2

vulkan: Fix data race/hang in scalar/cm1 flash attention (#17887)

jeffbolznv committed 12 days ago

Verified 3238b140

vulkan: improve mul_mat_vec_iq1_s speed (#17874)

lovedheart committed 12 days ago

Verified 47226716

vulkan: faster q6_k matmul (#17813)

netrunnereve committed 12 days ago

Verified d15d177f

model-conversion : cast logits to float32 (#18009)

ggerganov committed 12 days ago

Verified 77ad8542

models : fix YaRN regression + consolidate logic (#18006)

ggerganov committed 12 days ago

Verified 609a2d02

Older