ggerganov/llama.cpp

Pull Requests Commits

cont : try fix python init

ggerganov committed 1 day ago

Verified 8479be0e

ci : add metal server workflows

ggerganov committed 1 day ago

Verified 617ec152

graph : compute backend samplers only if needed

ggerganov committed 2 days ago

Verified 7f58ccae

sampling : delegate input allocation to the scheduler

ggerganov committed 2 days ago

Verified e0d4d456

model-conversion : add debug option to conversion script (#19265)

danbev committed 3 days ago

Verified 6156ae51

ggml-backend: fix async set/get fallback sync (#19179)

JohannesGaessler committed 3 days ago

Verified 59377a6c

authors : update (#19263)

ggerganov committed 3 days ago

Verified 1239267c

docs : Minor cleanups (#19252)

ckastner committed 3 days ago

Verified 7a4ca3cb

spec : various improvements ton ngram-map + docs (#19253)

srogmann committed 3 days ago

Verified b4d05a3d

Remove pipeline cache mutexes (#19195)

nikhilJain17 committed 3 days ago

Verified 2dc3ce21

Bump cmake max version (needed for Windows on Snapdragon builds) (#19188)

max-krasnyansky committed 3 days ago

Verified 3bc8d2cf

nix: fix allowUnfreePredicate for packages with multiple licenses (#19237)

typedrat committed 3 days ago

Verified 8a98ba45

create test.sh to enhance the parameters for testing, update the guide, rm useless script (#19243)

arthw committed 4 days ago

Verified 2634ed20

nix: fix nix develop .#python-scripts (#19218)

teto committed 4 days ago

Verified 41ea2614

ggml-hexagon: flash-attention and reduce-sum optimizations (#19141)

chraac committed 5 days ago

Verified 89f10baa

quantize: add option --tensor-type-file to llama-quantize (#18572)

EugeoSynthesisThirtyTwo committed 5 days ago

Verified 3dd95914

mtmd: support MiniCPM-o 4.5(vision only) (#19211)

tc-mb committed 5 days ago

Verified ec6c7421

lookup, lookahead: fix crash when n_ctx not specified (#18729)

pestopoppa committed 5 days ago

Verified 14883391

ngram-mod : fix build [no ci] (#19216)

ggerganov committed 5 days ago

Verified 49277958

opencl: add optimized q8_0 mm kernel for adreno (#18871)

shaofeiqi committed 5 days ago

Verified 971facc3

ggerganov committed 5 days ago

d9a2a4bc

cuda : fix compile warnings (whisper/0)

ggerganov committed 5 days ago

dfd6106c

server : wrap around the "id_slot" parameter (#19207)

ggerganov committed 5 days ago

Verified bbada8bf

Correctly fetch q8_1 quantize pipeline in test as needed by 8a3519b (#19194)

sredman committed 5 days ago

Verified 13f3ebfa

spec : add ngram-mod (#19164)

ggerganov committed 5 days ago

Verified dabaa2e7

jinja : add unordered_map include to value.h [no ci] (#19205)

mseri committed 5 days ago

Verified 2e916f99

memory : clarify comments for r_l and s_l tensors [no ci] (#19203)

danbev committed 5 days ago

Verified f3bc9889

tests : add GQA=20 FA test (#19095)

ggerganov committed 5 days ago

Verified c3b87ceb

convert : add missing return statement for GraniteMoeModel (#19202)

danbev committed 6 days ago

Verified 05625031

memory : remove unused tmp_buf (#19199)

danbev committed 6 days ago

Verified 83bcdf72

Older