ggerganov/llama.cpp

Pull Requests Commits

add openmp lib to dockerfiles

slaren committed 349 days ago

3d2e79da

Fix encoding in python scripts (#7733)

Galunid committed 349 days ago

Verified 7672adee

CUDA: refactor mmq, dmmv, mmvq (#7716)

JohannesGaessler committed 349 days ago

Verified 7d1a378b

ggml : refactor rope norm/neox (#7634)

ggerganov committed 349 days ago

Verified 2b338967

readme : remove -ins (#7759)

arch-btw committed 349 days ago

Verified 9973e81c

Fix per token atrributes bits (#7749)

jaime-m-p committed 350 days ago

Verified c90dbe02

Allow number of nodes in CUDA graph to change (#7738)

agray3 committed 350 days ago

Verified b90dc566

common : refactor cli arg parsing (#7675)

ggerganov committed 350 days ago

Verified 1442677f

ggml : remove OpenCL (#7735)

ggerganov committed 350 days ago

Verified 554c247c

llama : remove beam search (#7736)

ggerganov committed 350 days ago

Verified 0cd6bd34

readme : remove obsolete Zig instructions (#7471)

ggerganov committed 350 days ago

Verified 5ca0944a

llama-bench : allow using a different printer for stderr with -oe (#7722)

slaren committed 350 days ago

Verified adc9ff38

Improve hipBLAS support in CMake (#7696)

daniandtheweb committed 350 days ago

Verified 987d743d

refine .gitignore (#7688)

zhouwg committed 350 days ago

Verified b226c122

Per token attributes (#7685)

jaime-m-p committed 350 days ago

Verified 3b38d486

ggml : prevent builds with -ffinite-math-only (#7726)

ggerganov committed 350 days ago

Verified 6d161694

llama : offload to RPC in addition to other backends (#7640)

rgerganov committed 351 days ago

Verified bde7cd3c

ggml : use OpenMP as a thread pool (#7606)

msy-kato committed 351 days ago

Verified a5735e44

make: fix debug options not being applied to NVCC (#7714)

JohannesGaessler committed 351 days ago

Verified 0b832d53

Vulkan Mixture of Experts (MoE) support (#7628)

0cc4m committed 351 days ago

Verified 3d7ebf63

cmake : add pkg-config spec file for llama.cpp (#7702)

andy-tai committed 351 days ago

Verified a10cda58

llama : MiniCPM support tied embeddings (#7664)

zkh2016 committed 351 days ago

Verified 6f28a333

llama : avoid double token-to-piece cache (#7654)

ggerganov committed 351 days ago

Verified 549279d8

kompute : implement op_getrows_f32 (#6403)

woachk committed 351 days ago

Verified 9e405b6e

fix bug introduced in using calloc (#7701)

airlied committed 352 days ago

Verified 3413ae21

flake.lock: Update (#7686)

ggerganov committed 352 days ago

Verified 1669810d

chore : add ignore rule for generated server themes (#7689)

teleprint-me committed 352 days ago

Verified 7c4e5b7e

[SYCL] Update rpc-server.cpp to include SYCL backend (#7682)

nickp27 committed 352 days ago

Verified 9422c5e3

Fix FlashAttention debug test, FP32 assert (#7684)

JohannesGaessler committed 353 days ago

Verified e141ce62

server : new UI (#7633)

mounta11n committed 353 days ago

Verified 2e666832

Older