ggerganov/llama.cpp

Pull Requests Commits

airMeng committed 1 year ago

64945098

airMeng committed 1 year ago

b180cb35

llama : use F32 precision in GLM4 attention and no FA (#9130)

piDack committed 1 year ago

Verified a07c32ea

[SYCL] Add a space to supress a cmake warning (#9133)

qnixsynapse committed 1 year ago

Verified 11b84eb4

[SYCL] Add oneDNN primitive support (#9091)

luoyu-intel committed 1 year ago

Verified 1731d423

llama : simplify Mamba with advanced batch splits (#8526)

compilade committed 1 year ago

Verified a1631e53

server : support reading arguments from environment variables (#9105)

ngxson committed 1 year ago

Verified fc54ef0d

llama : support for `falcon-mamba` architecture (#9074)

younesbelkada committed 1 year ago

Verified b40eb848

llava : zero-initialize clip_ctx structure fields with aggregate initialization 908)

fairydreaming committed 1 year ago

Verified f63f603c

llama : std::move llm_bigram_bpe from work_queue (#9062)

danbev committed 1 year ago

Verified 8455340b

llava: Add ACC OP for GPU acceleration to the Vulkan backend in the LLAVA CLIP model. (#8984)

cyzero-kim committed 1 year ago

Verified 2f3c1466

[SYCL] fallback mmvq (#9088)

airMeng committed 1 year ago

Verified 50addec9

[SYCL] Fix SYCL `im2col` and `convert` Overflow with Large Dims (#9052)

zhentaoyu committed 1 year ago

Verified 4f8d19ff

tests : add missing comma in grammar integration tests (#9099)

fairydreaming committed 1 year ago

Verified 90db8146

cann: add doc for cann backend (#8867)

wangshuai09 committed 1 year ago

Verified cfac111e

rpc : print error message when failed to connect endpoint (#9042)

rgerganov committed 1 year ago

Verified 1b6ff90f

rpc : prevent crashes on invalid input (#9040)

rgerganov committed 1 year ago

Verified 18eaf29f

flake.lock: Update (#9068)

ggerganov committed 1 year ago

Verified 554b0490

tests : add integration test for lora adapters (#8957)

ltoniazzi committed 1 year ago

Verified 2339a0be

Fix incorrect use of ctx_split for bias tensors (#9063)

suhara committed 1 year ago

Verified 2fb92678

server : refactor middleware and /health endpoint (#9056)

ngxson committed 1 year ago

Verified 8b3befc0

llava : support MiniCPM-V-2.6 (#8967)

tc-mb committed 1 year ago

Verified d565bb2f

py : fix wrong input type for raw_dtype in ggml to gguf scripts (#8928)

farbodbj committed 1 year ago

Verified ee2984bd

Fix inference example lacks required parameters (#9035)

Aisuko committed 1 year ago

Verified c8ddce85

gguf-py : bump version from 0.9.1 to 0.10.0 (#9051)

compilade committed 1 year ago

Verified 23fd4535

llama : add EXAONE model support (#9025)

mscheong01 committed 1 year ago

Verified c679e0cb

common : add support for cpu_get_num_physical_cores() on Windows (#8771)

Septa2112 committed 1 year ago

Verified fb487bb5

Add Nemotron/Minitron GGUF Conversion & Inference Support (#8922)

suhara committed 1 year ago

Verified 2a24c8ca

ggml : dynamic ggml_sched_max_splits based on graph_size (#9047)

nicoboss committed 1 year ago

Verified e3f6fd56

retrieval : fix memory leak in retrieval query handling (#8955)

gtygo committed 1 year ago

Verified 4b9afbbe

Older