ggerganov/llama.cpp

Pull Requests Commits

add tool to allow plotting tensor allocation maps within buffers

slaren committed 1 year ago

cad8abb4

simple : update name of executable to llama-simple (#8885)

danbev committed 1 year ago

Verified 5f4dcb1e

cmake : Link vulkan-shaders-gen with pthreads (#8835)

Patater committed 1 year ago

Verified db20f50c

[Vulkan] Fix compilation of `vulkan-shaders-gen` on w64devkit after `e31a4f6` (#8880)

MaggotHATE committed 1 year ago

Verified efda90c9

contributing : add note about write access

ggerganov committed 1 year ago

Verified 0bf16de0

ggml : add epsilon as a parameter for group_norm (#8818)

MollySophia committed 1 year ago

Verified 2d5dd7bb

convert : add support for XLMRoberta embedding models (#8658)

iamlemec committed 1 year ago

Verified cdd1889d

[CANN]: Fix ggml_backend_cann_buffer_get_tensor (#8871)

MengqingCao committed 1 year ago

Verified c21a8964

[SYCL] correct cmd name (#8877)

arthw committed 1 year ago

Verified d4ff8471

common : Changed tuple to struct (TODO fix) (#8823)

Septa2112 committed 1 year ago

Verified 0a4ce786

cann: fix buffer_num and runtime speed slowly error (#8865)

wangshuai09 committed 1 year ago

Verified bc0f887e

readme : add ramalama to the availables UI (#8811)

ericcurtin committed 1 year ago

Verified b42978e7

ggml : fix overflows in elu function (#8866)

jart committed 1 year ago

Verified b9dfc25c

py: Add more authorship metadata from model card (#8810)

mofosyne committed 1 year ago

Verified 1ef14b30

Stop the generation when <|eom_id|> token is encountered - needed for Llama 3.1 tool call support (#8858)

fairydreaming committed 1 year ago

Verified d3f0c716

cmake: fix paths for vulkan shaders compilation on Windows (#8573)

stduhpf committed 1 year ago

Verified e31a4f67

readme : update model list (#8851)

BarfingLemurs committed 1 year ago

Verified 400ae6f6

llama : better replace_all (#8852)

ggerganov committed 1 year ago

Verified f1ea5146

vulkan : fix Qantized Mat-Vec Mul on AMD GPUs for ncols < 64 (#8855)

0cc4m committed 1 year ago

Verified 064cdc26

ggerganov committed 1 year ago

5587e57a

vulkan : implement Stable Diffusion operators (ggml/904)

0cc4m committed 1 year ago

a3738b2f

ggml : move c parameter comment to ggml_rope_ext (ggml/901)

danbev committed 1 year ago

655858ac

cann: support q4_0 model (#8822)

wangshuai09 committed 1 year ago

Verified c02b0a8a

Install curl in runtime layer (#8693)

bsquizz committed 1 year ago

Verified 0d6fb52b

Server: Don't ignore llama.cpp params (#8754)

ardfork committed 1 year ago

Verified 978ba3d8

batched-bench : handle empty `-npl` (#8839)

cunnie committed 1 year ago

Verified ecf6b7f2

baby-llama : remove duplicate vector include

danbev committed 1 year ago

01aae2b4

flake.lock: Update (#8847)

ggerganov committed 1 year ago

Verified 4b77ea95

ggml : reading the runtime sve config of the cpu (#8709)

jdomke committed 1 year ago

Verified 76614f35

Fix conversion of unnormalized BF16->BF16 weights (#7843)

CISC committed 1 year ago

Verified b72c20b8

Older