ggerganov/llama.cpp

Pull Requests Commits

server-stream : pimpl

ggerganov committed 68 days ago

Verified 50048594

ggml-cpu: fix SVE leftover path in ggml_vec_dot_f32 (#24699)

tdakhran committed 68 days ago

Verified c16c35b8

server + ui: SSE Replay Buffer (#23226)

ServeurpersoCom committed 68 days ago

Verified 1a87dcdc

sycl : clamp softmax input to avoid underflow (#24941)

Jassieluo committed 68 days ago

Verified e7e3f350

mtmd: add more validations (#25013)

ngxson committed 68 days ago

Verified b11f7c16

CUDA: batch out_prod broadcast (dps2>1) path with cublasSgemmBatched (#24426)

leonardHONG committed 68 days ago

Verified f818065d

mamba2: remove hardcoded 2x expansion factor and invalid d_inner % d_state check (#23082)

limloop committed 68 days ago

Verified 960d628f

opencl: flush profiling batch at shutdown for incomplete batches (#25016)

shaofeiqi committed 68 days ago

Verified 5c7c22c3

xcframework : disable mtmd video on i/tv/visionos (#25018)

CISC committed 69 days ago

Verified beac5309

model : Add label for LFM2.5-230M (#25008)

tdakhran committed 69 days ago

Verified 9d5d882d

CUDA: Various fixes to `cpy.cu` (#25000)

ORippler committed 69 days ago

Verified 1ec44d17

misc: fix labeler (#25012)

ngxson committed 69 days ago

Verified c7cddefc

server: use status code 403 for disabled features (#24970)

ngxson committed 69 days ago

Verified e9d1b76d

misc: update lables (#24920)

ngxson committed 69 days ago

Verified 099bf069

common: refactor model handling (#24980)

ngxson committed 69 days ago

Verified 60bc8866

docs : Eagle3 qwen3 draft model support (#24977)

kashif committed 69 days ago

Verified e8ecce53

app : add the llama download subcommand (#24982)

angt committed 69 days ago

Verified 683b04cc

ggml : address integer overflows in binary ops CUDA implementation (#24706)

fairydreaming committed 69 days ago

Verified f728adab

ui: fix always-show-sidebar-on-desktop setting after navigation refactor (#24979)

ServeurpersoCom committed 69 days ago

Verified 3e61ea0e

tests : synchronize contexts at end of test-thread-safety (#24935)

krystophny committed 69 days ago

Verified fdbd6abe

build: include libmtmd in Apple XCFramework (#21935)

theabecaster committed 69 days ago

Verified e12a0128

quant : fix quantizing moe with mtp (#24986)

CISC committed 69 days ago

Verified b3ce5ced

sycl : support --split-mode tensor (#24152)

Spruill-1 committed 69 days ago

Verified e9fb3b3f

sycl : fix the failed UT cases of conv_3d (#24900)

arthw committed 69 days ago

Verified 9c109548

opencl: support non-contig rows in norm (#24965)

lhez committed 69 days ago

Verified fdb2c11c

chat: harden caps check (#24973)

pwilkin committed 69 days ago

Verified 09cedfd6

hexagon: MUL_MAT and MUL_MAT_ID rework : 32x32 tiled weight repack, kernel-params, cached graphs (#24954)

max-krasnyansky committed 70 days ago

Verified 8be759e6

mtmd: model: unlimited-ocr: converter + parity test (#24969)

sfallah committed 70 days ago

Verified 894bb27a

common: remove unused json-partial (#24968)

ngxson committed 70 days ago

Verified fb401045

vulkan: allow reducing the graph submission batches to avoid timeouts (#24872)

wbruna committed 70 days ago

Verified 51eae8cf

Older