ochafik/llama.cpp

Pull Requests Commits

support permuted, remove check s0/s10 (#19889)

arthw committed 73 days ago

Verified 2943210c

vulkan: check for memory overlap before doing fusion (#19768)

jeffbolznv committed 73 days ago

Verified 3769fe6e

common : add more aliases for sampler CLI params (#19797)

ddh0 committed 73 days ago

Verified 832aa947

ci : update the ROCm/HIP toolchain versions [no ci] (#19891)

slojosic-amd committed 73 days ago

Verified 3af34b9f

server : enable multi-modal prompt caching (#19877)

ggerganov committed 73 days ago

Verified f20469d9

server : support multi-modal context checkpoints (#19849)

ggerganov committed 73 days ago

Verified d7d826b3

scripts: update corpus of compare-logprobs (#19326)

ngxson committed 74 days ago

Verified c747294b

ci : update Windows ROCm build to 26.Q1 [no ci] (#19810)

superm1 committed 74 days ago

Verified 8fdf269d

gguf : fix ftell/fseek for Windows (#19870)

aldehir committed 74 days ago

Verified a96a1120

models : fix graph splits (#19866)

ggerganov committed 74 days ago

Verified 24464195

server: fix query params lost when proxying requests in multi-model router mode (#19854)

ServeurpersoCom committed 74 days ago

Verified 47eb12b9

ggml/gguf : prevent integer overflows (#19856)

ggerganov committed 74 days ago

Verified 418dea39

model : update label for LFM2-24B-A2B (#19848)

tdakhran committed 74 days ago

Verified da426cb2

server : support max_completion_tokens request property (#19831)

rgerganov committed 75 days ago

Verified c830f99c

Vulkan Scalar Flash Attention Refactor (#19625)

0cc4m committed 75 days ago

Verified aa6f918c

vulkan: fix coopmat1 without bf16 support (#19793)

jeffbolznv committed 75 days ago

Verified 8c2c0108

vulkan: fix data race in mul_mat_id shader (#19790)

jeffbolznv committed 75 days ago

Verified 3ea5360c

hexagon refactor all Ops to use local context struct (#19819)

max-krasnyansky committed 75 days ago

Verified 39fb81f8

feat: Add code blocks full height setting to parameter sync service (#19835)

allozaur committed 75 days ago

Verified 5eb0ea32

vendor : update cpp-httplib to 0.34.0 (#19830)

angt committed 75 days ago

Verified b68a83e6

tests : fix typos in comments in test-backend-sampler [no ci] (#19824)

danbev committed 75 days ago

Verified d8aeb65c

webui: Add setting to have full height Code Blocks in Chat Messages (#19829)

allozaur committed 75 days ago

Verified 9051663d

model-conversion : merge inspect-org-model.py with tensor-info.py (#19823)

danbev committed 75 days ago

Verified 72b44c0d

ggml-cpu: arm64: q5_K repack gemm and gemv (and generic) implementations (dotprod) (#19356)

Alcpz committed 75 days ago

Verified bc160d35

llama : remove write/read of output ids/logits/embeddings (#18862)

danbev committed 76 days ago

Verified 2b6dfe82

cli : provide model with text filename (#19783)

CISC committed 76 days ago

Verified e8e26169

jinja: correct stats for tojson and string filters (#19785)

ngxson committed 76 days ago

Verified 5452d736

common : fix improper trimming in XML parser on complete message (#19805)

aldehir committed 76 days ago

Verified ed483789

Fix wrong cli-argument in documentation (#19804)

Menkalian committed 76 days ago

Verified cacc371f

model : add Kanana-2 model support (#19803)

HelloKS committed 76 days ago

Verified ae2368e7

Older