sync : ggml #2561

ggerganov merged 55 commits into master from sync
ggerganov
ggerganov scripts : update sync
62eeaafc
pminev metal : fix minor string leaks (ggml/1004)
a53ac6f9
ykhrustalev cmake : make it possible linking ggml as external lib (ggml/1003)
787b66fc
yeahdongcn musa: workaround for Guilty Lockup in cleaning src0 (llama/10042)
85c678cf
cyzero-kim ggml: Add POOL2D OP for GPU acceleration to the Vulkan backend in the…
5d22f5b5
slaren llama : refactor model loader with backend registry (llama/10026)
a0ea7d47
xctan ggml : add Q4_0_8_8 RISC-V GEMV and GEMM kernels (llama/10029)
39fdd62f
slaren ggml : fix memory leaks when loading invalid gguf files (llama/10094)
4cbca543
slp kompute: add backend registry / device interfaces (llama/10045)
d378f19e
slp kompute: add mul_mat_q4_k shader (llama/10097)
18122841
slaren ggml : check tensor name lengths in gguf files (llama/10100)
1c837521
slaren llama : fix buffer checks for mamba and rwk (llama/10111)
6b7f6bec
kylo5aby build: fix build error in Windows env with OneAPI setup (llama/10107)
72cbb25c
ggerganov ggml : remove ggml_scratch (llama/10121)
6352fcd6
FanShupei vulkan : improve ggml_vk_create_buffer error handling (llama/9898)
c28c6e85
slaren llama : use smart pointers for ggml resources (llama/10117)
c7c5a952
slaren llama : add simple-chat example (llama/10124)
749d287c
ggerganov metal : minor fixup in FA kernel (llama/10143)
384ee00d
slaren ggml : move CPU backend to a separate file (llama/10144)
63f72869
leo-pony CANN: adjust backend registry refactor. (llama/10158)
fa240b25
ggerganov metal : move dequantize templates to beginning of MSL source (llama/0)
e75a4534
ggerganov metal : simplify f16 and f32 dequant kernels (llama/0)
e72fc8ab
slaren cuda : clear error after changing peer access (llama/10153)
801fdc22
snadampal fix build break on arm64 linux (llama/10166)
03b75f41
slaren ggml : fix q4xx mat mul, increase ggml_aligned_malloc alignment (llam…
c7655fe2
slaren ggml : fix gelu tables initialization (llama/10172)
45ecfd9a
netrunnereve Q6_K AVX improvements (llama/10118)
26e5a758
slaren ggml : fix arch check in bf16_to_fp32 (llama/10164)
7580d7ea
ggerganov metal : add quantized FA support (llama/10149)
8aaa1e95
ggerganov ggml : adjust is_first_call init value (llama/10193)
354191fb
slaren metal : fix from ptr buffer name (llama/10189)
406c648a
ggerganov metal : add BF16 support (llama/8439)
42cbecec
Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acc…
b8fbee45
snadampal fix q4_0_8_8 format for corrupted tokens issue (llama/10198)
3cae70b9
slaren ggml : add ggml-cpu.h to the public headers (llama/10204)
44c0abf3
ggerganov metal : optimize FA kernels (llama/10171)
d6fb23bb
ggerganov metal : improve clarity (minor) (llama/10171)
2b11c93f
ggerganov metal : opt-in compile flag for BF16 (llama/10218)
6998ecfe
amritahs-ibm ggml : optimize llamafile cpu matrix multiplication for ppc64le (llam…
f48abc2b
SongXiaoXi ggml: fix zero division in ‘dne’ calculation in CUDA COUNT_EQUAL oper…
d54b0d2b
ggerganov metal : hide debug messages from normal log
065fc31a
ggerganov metal : fix F32 accumulation in FA vec kernel (llama/10232)
be6999ed
ggerganov metal : fix build and some more comments (llama/10229)
e47d0eb0
ggerganov metal : reorder write loop in mul mat kernel + style (llama/10231)
8536022f
jeffbolznv vulkan: Fix newly added tests for permuted mul_mat and 1D im2col (lla…
db5507a3
ggerganov metal : more precise Q*K in FA vec kernel (llama/10247)
c4c4d888
jeffbolznv vulkan: Throttle the number of shader compiles during the build step.…
b606ad2f
jeffbolznv vulkan: Optimize contiguous copies (llama/10254)
c60ae68c
sycl : Fixes to broken builds and test-backend-ops (llama/10257)
3b637d42
ggerganov sync : ggml
3c337b22
ggerganov whisper : fix build (#0)
3df5e16d
ggerganov talk-llama : sync llama.cpp
d93631c4
ggerganov ggerganov force pushed from 86aacb4b to ae635989 1 year ago
ggerganov ggerganov force pushed from ae635989 to 64fc546b 1 year ago
ggerganov ggerganov force pushed from 64fc546b to be609e34 1 year ago
ggerganov build : fixes
19927ad8
ggerganov whisper : include ggml-cpu.h (#0)
463849af
ggerganov cmake : fix ppc64 check (#0)
f94863ee
ggerganov ggerganov force pushed from 558a43a0 to f94863ee 1 year ago
ggerganov ggerganov merged e23721f3 into master 1 year ago
ggerganov ggerganov deleted the sync branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone