ngxson/llama.cpp

Pull Requests Commits

ggml : fix condition of im2col on Metal backend

ngxson committed 1 year ago

48085b2e

server: fix OpenAI API compatibility for usage statistics in chat streams (#15444)

TeoZosa committed 1 year ago

Verified 1bc664a2

CUDA: refactor FA support/selection code (#15454)

JohannesGaessler committed 1 year ago

Verified 13aeb7ae

CUDA: replace GGML_CUDA_F16 with CUDA arch checks (#15433)

JohannesGaessler committed 1 year ago

Verified 7a6e91ad

vulkan: shorten pipeline name strings (#15431)

jeffbolznv committed 1 year ago

Verified fec95198

chat: handle gpt-oss return/end token inconsistency (#15421)

danbev committed 1 year ago

Verified 657b8a77

common : fix context shift help message (#15448)

DamonFool committed 1 year ago

Verified ec5ab1a3

cmake : fix target include directories (#15450)

xiaobing318 committed 1 year ago

Verified 1a99c2d9

make : remove make in favor of CMake (#15449)

danbev committed 1 year ago

Verified 37f10f95

lookahead : add sample command to readme (#15447)

ggerganov committed 1 year ago

Verified 2f370140

musa: fix build warnings (#15258)

yeahdongcn committed 1 year ago

Verified a094f381

opencl: mark `argsort` unsupported if cols exceed workgroup limit (#15375)

lhez committed 1 year ago

Verified fb22dd07

model : add gpt-oss type strings (#15424)

ggerganov committed 1 year ago

Verified 9ef6b0b8

common : Add top-nsigma sampler to help globally (#15428)

gcp committed 1 year ago

Verified 1e19f5d4

server : disable context shift by default (#15416)

ggerganov committed 1 year ago

Verified d2fcd91c

CANN: optimize rope operator (#15335)

YangShuai52 committed 1 year ago

Verified a6d3cfe7

musa: handle __hgt2_mask, available starting from MUSA SDK rc4.3.0 (#15413)

yeahdongcn committed 1 year ago

Verified 67f09a3a

ggml-cpu: add mxfp4 VSX intrinsics for Power9+ (ppc64le) hardware (#15385)

mgiessing committed 1 year ago

Verified 6424594c

chat : clarify the meaning of reasoning_format (#15408)

ngxson committed 1 year ago

Verified e9288e88

server : remove swa_full warning (#15399)

ggerganov committed 1 year ago

Verified 9d262f4b

batched-bench : use rand tokens (#15398)

ggerganov committed 1 year ago

Verified f0d3c740

mtmd : clean up clip_n_output_tokens (#15391)

ngxson committed 1 year ago

Verified f08c4c0d

codeowners : remove mmv.*

ggerganov committed 1 year ago

6d7f1117

ggerganov committed 1 year ago

60212f1e

scripts : update sync scripts

ggerganov committed 1 year ago

f0c541d3

llama : merge conts and reshapes and remove unnecessary cont (#15380)

CISC committed 1 year ago

Verified baa9255a

readme : update hot topics (#15397)

ggerganov committed 1 year ago

Verified 3007baf2

server : fix incoming tasks not process in order (#15395)

davidef committed 1 year ago

Verified d1d82416

Fix broken build: require updated pip to support --break-system-packages (#15357)

danchev committed 1 year ago

Verified 618575c5

ggml-quants : fix make_qp_quants NANs and IQ1 assertion errors (#15379)

compilade committed 1 year ago

Verified f44f7931

Older