ngxson/llama.cpp

Pull Requests Commits

mtmd: add min/max pixels gguf metadata

ngxson committed 22 days ago

ad58aac3

server: print actual model name in 'model not found" error (#19117)

teto committed 22 days ago

Verified a3fa0358

ci: add test-backend-ops test for CPU (#19268)

am17an committed 22 days ago

Verified 15818ac4

Remove support for Nvidia & AMD GPU, because the oneAPI plugin for Nvidia & AMD GPU is unavailable: download/installation channels are out of work. (#19246)

arthw committed 22 days ago

Verified bf38346d

sycl: implement GGML_OP_TOP_K (#19242)

tdevelope committed 22 days ago

Verified 4d5e9726

metal : support virtual devices (#18919)

ggerganov committed 22 days ago

Verified 6fdddb49

model-conversion : add debug option to conversion script (#19265)

danbev committed 23 days ago

Verified 6156ae51

ggml-backend: fix async set/get fallback sync (#19179)

JohannesGaessler committed 23 days ago

Verified 59377a6c

authors : update (#19263)

ggerganov committed 23 days ago

Verified 1239267c

docs : Minor cleanups (#19252)

ckastner committed 23 days ago

Verified 7a4ca3cb

spec : various improvements ton ngram-map + docs (#19253)

srogmann committed 23 days ago

Verified b4d05a3d

Remove pipeline cache mutexes (#19195)

nikhilJain17 committed 23 days ago

Verified 2dc3ce21

Bump cmake max version (needed for Windows on Snapdragon builds) (#19188)

max-krasnyansky committed 23 days ago

Verified 3bc8d2cf

nix: fix allowUnfreePredicate for packages with multiple licenses (#19237)

typedrat committed 23 days ago

Verified 8a98ba45

create test.sh to enhance the parameters for testing, update the guide, rm useless script (#19243)

arthw committed 24 days ago

Verified 2634ed20

nix: fix nix develop .#python-scripts (#19218)

teto committed 24 days ago

Verified 41ea2614

ggml-hexagon: flash-attention and reduce-sum optimizations (#19141)

chraac committed 25 days ago

Verified 89f10baa

quantize: add option --tensor-type-file to llama-quantize (#18572)

EugeoSynthesisThirtyTwo committed 25 days ago

Verified 3dd95914

mtmd: support MiniCPM-o 4.5(vision only) (#19211)

tc-mb committed 25 days ago

Verified ec6c7421

lookup, lookahead: fix crash when n_ctx not specified (#18729)

pestopoppa committed 25 days ago

Verified 14883391

ngram-mod : fix build [no ci] (#19216)

ggerganov committed 25 days ago

Verified 49277958

opencl: add optimized q8_0 mm kernel for adreno (#18871)

shaofeiqi committed 25 days ago

Verified 971facc3

ggerganov committed 25 days ago

d9a2a4bc

cuda : fix compile warnings (whisper/0)

ggerganov committed 25 days ago

dfd6106c

server : wrap around the "id_slot" parameter (#19207)

ggerganov committed 25 days ago

Verified bbada8bf

Correctly fetch q8_1 quantize pipeline in test as needed by 8a3519b (#19194)

sredman committed 25 days ago

Verified 13f3ebfa

spec : add ngram-mod (#19164)

ggerganov committed 25 days ago

Verified dabaa2e7

jinja : add unordered_map include to value.h [no ci] (#19205)

mseri committed 25 days ago

Verified 2e916f99

memory : clarify comments for r_l and s_l tensors [no ci] (#19203)

danbev committed 25 days ago

Verified f3bc9889

tests : add GQA=20 FA test (#19095)

ggerganov committed 25 days ago

Verified c3b87ceb

Older