ngxson/llama.cpp

Pull Requests Commits

revert naming order

ngxson committed 1 year ago

f59a199e

apply review suggesions

ngxson committed 1 year ago

e3b7b98a

rename na --> erf

ngxson committed 1 year ago

65730bc8

fix naming order

ngxson committed 1 year ago

bddf57bd

ggml : add ggml_gelu_na (not approximated)

ngxson committed 1 year ago

c78210a2

llama : remove llama_kv_cache_view API + remove deprecated (#13653)

ggerganov committed 1 year ago

Verified a4090d11

CUDA: skip fully masked-out KV in FA vec kernel (#13584)

JohannesGaessler committed 1 year ago

Verified b69f1647

tests : avoid github urls due to throttling (#13654)

CISC committed 1 year ago

Verified 759e37b0

sycl: disable reorder for sycl mulmat (#13536)

sgeor255 committed 1 year ago

Verified 4245e622

Set GLM4 blk.*.attn_output.weight, kqv_out-* matmul to GGML_PREC_F32 to fix infinity values in output (#13639)

0cc4m committed 1 year ago

Verified c9c64dee

metal : fix typo in FA kernel comments (#13651)

ggerganov committed 1 year ago

Verified c00a2634

kv-cache : add SWA support (#13194)

ggerganov committed 1 year ago

Verified e298d2fb

CANN: Update CANN model support (#13162)

bachelor-dou committed 1 year ago

Verified f0adb80b

sycl : Overcoming workaround for mmap() allocation on Windows (#13482)

s-Nick committed 1 year ago

Verified f7c9429c

common : add load_progress_callback (#13617)

psocolovsky committed 1 year ago

Verified 1dfbf2cf

Vulkan: Add f32 accumulator support to quantized mul mat to fix GLM4 32B incoherence (#13607)

0cc4m committed 1 year ago

Verified 8960efd0

sycl : backend documentation review (#13544)

Alberto Cabrera Pérez committed 1 year ago

Verified 725f23f1

mtmd : add vision support for llama 4 (#13282)

ngxson committed 1 year ago

Verified 92ecdcc0

ci : upgraded oneAPI version in SYCL workflows and dockerfile (#13532)

Alberto Cabrera Pérez committed 1 year ago

Verified f71f40a2

ggerganov committed 1 year ago

d30cb5a7

mnist: fix segmentation fault (ggml/1227)

JohannesGaessler committed 1 year ago

6c35981a

ggml : fix apple OS check in ggml_print_backtrace (ggml/1229)

slaren committed 1 year ago

8b5e19ae

ggml : Fix missing backtrace on Linux (ggml/1228)

danielzgtg committed 1 year ago

60aea028

fix: check model pointer validity before use (#13631)

D2hugging committed 1 year ago

Verified 9c55e5c5

CANN: Support MOE Model MUL_MAT_ID (#13042)

noemotiovon committed 1 year ago

Verified 33d7aed4

server : added --no-prefill-assistant flag (#13608)

isaac-mcfadyen committed 1 year ago

Verified 6a2bc8bf

cmake: use the current build config for vulkan-shaders-gen (#13595)

giladgd committed 1 year ago

Verified e3a7cf6c

parallel : add option for non-shared and larger prompts (#13598)

ggerganov committed 1 year ago

Verified 518329b2

vulkan: move common FA code to flash_attn_base.comp (#13556)

jeffbolznv committed 1 year ago

Verified 2f5a4e1e

vulkan: use scalar FA rather than coopmat2 when N==1 (#13554)

jeffbolznv committed 1 year ago

Verified 4f41ee11

Older