ggml-org/llama.cpp

Pull Requests Commits

ci : reduce severity of unused Pyright ignore comments

compilade committed 344 days ago

a34fc0dd

py : update transfomers version (#9694)

Vaibhavs10 committed 344 days ago

Verified 08a43d05

flake.lock: Update (#9680)

ggerganov committed 344 days ago

Verified ace4f4be

console : utf-8 fix for windows stdin (#9690)

hasaranga committed 344 days ago

Verified 8277a817

ggml : define missing HWCAP flags (#9684)

ggerganov committed 345 days ago

Verified c919d5db

ggerganov committed 345 days ago

Verified d0b1d663

CUDA: remove bad assert (ggml/972)

JohannesGaessler committed 345 days ago

Verified aaa40999

vulkan : multithread pipeline creation (ggml/963)

jeffbolznv committed 345 days ago

Verified 641002fb

vulkan : fix build for GGML_VULKAN_RUN_TESTS, add TFLOPS to log (ggml/961)

jeffbolznv committed 345 days ago

Verified 0de8b203

vulkan : argsort barriers must be under uniform control flow (ggml/951)

smeso committed 345 days ago

Verified 544f409b

ggml : fix GGML_MAX_N_THREADS + improve formatting (ggml/969)

ggerganov committed 345 days ago

Verified 6084bfb2

common : ensure llama_batch size does not exceed max size (#9668)

matiaslin committed 345 days ago

Verified faac0bae

py : add model class for Chameleon conversion (#9683)

nopperl committed 345 days ago

Verified f99d3f83

contrib : add Resources section (#9675)

ggerganov committed 345 days ago

Verified 589b48d4

llama : add reranking support (#9510)

ggerganov committed 346 days ago

Verified f4d2b884

test-backend-ops : use flops for some performance tests (#9657)

slaren committed 346 days ago

Verified 1b2f992c

llama : add comment about thread-safety [no ci] (#9449)

ggerganov committed 346 days ago

Verified 73984270

vocab : refactor tokenizer to reduce init overhead (#9449)

kylo5aby committed 346 days ago

Verified 6102037b

llama : add support for Chameleon (#8543)

nopperl committed 346 days ago

Verified 9a913110

readme : add tool (#9655)

akx committed 346 days ago

Verified 43bcdd97

ggml : add run-time detection of neon, i8mm and sve (#9331)

eddnjjn committed 346 days ago

Verified 6a0f7794

Enable use to the rebar feature to upload buffers to the device. (#9251)

mtavenrath committed 346 days ago

Verified 89f99449

readme : update hot topics

ggerganov committed 347 days ago

Verified b5de3b74

cmake : add option for common library (#9661)

iboB committed 347 days ago

Verified 44f59b43

[SYCL] add missed dll file in package (#9577)

NeoZhangJianyu committed 348 days ago

Verified 95bc82fb

mtgpu: enable VMM (#9597)

yeahdongcn committed 348 days ago

Verified 7691654c

ci : fix docker build number and tag name (#9638)

ngxson committed 349 days ago

Verified ea9c32be

ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (#9217)

chaxu01 committed 349 days ago

Verified 1e436302

server : add more env vars, improve gen-docs (#9635)

ngxson committed 349 days ago

Verified afbbfaa5

llama : add IBM Granite MoE architecture (#9438)

gabe-l-hart committed 349 days ago

Verified 3d6bf691

Older