ggml-org/ggml

Pull Requests Commits

sync : llama.cpp

ggerganov committed 1 year ago

Verified d0f7473c

threading: support for GGML_SCHED_PRIO_LOW, update thread info on Windows to avoid throttling (llama/12995)

max-krasnyansky committed 1 year ago

Verified 8b09bced

CUDA: add a prop in ggml_cuda_device_infor for distinguish iGPU or dGPU in cuda (#13856) (llama/13895)

Yangxiaoz committed 1 year ago

Verified 8720cc16

CUDA: fix typo in FlashAttention code (llama/13926)

JohannesGaessler committed 1 year ago

Verified ad9d6e65

sched : avoid changing cur_copy when a graph is already allocated (llama/13922)

slaren committed 1 year ago

Verified c6689ee5

cuda : prevent using split buffers with 3d/4d matrices (llama/13919)

slaren committed 1 year ago

Verified e2a95aad

SYCL: Add mrope kernel (llama/13755)

qnixsynapse committed 1 year ago

Verified d31232fa

cmake: Guard GGML_CPU_ALL_VARIANTS by architecture (llama/13890)

ckastner committed 1 year ago

Verified 7fe6f98c

arm64: optimize q4_k_q8_k kernel with i8mm (llama/13886)

cyb70289 committed 1 year ago

Verified ec3cddea

cmake: Factor out CPU architecture detection (llama/13883)

ckastner committed 1 year ago

Verified 5c0838a2

ggml: aarch64: Implement SVE F32 kernels for Mamba Sequential Scan Algorithm (llama/13882)

vineelabhinav committed 1 year ago

Verified 2efa671d

ggml: aarch64: Implement SVE F32 kernels for vector functions (llama/13843)

vineelabhinav committed 1 year ago

Verified 0508222f

CUDA: fix FA tg at long context for CC >= 8.9 (llama/13852)

JohannesGaessler committed 1 year ago

Verified 1d346a5c

CANN: Add SOC TYPE printing in cmake configuration (llama/13837)

leo-pony committed 1 year ago

Verified abd78ce4

opencl: add new ops - `argsort`, `div`, `sub`, `addrows`, `sigmoid`, `group_norm` (llama/13787)

lhez committed 1 year ago

Verified 8a703636

opencl: mark `mul_mat` `f32f32` as supporting non-contiguous tensors (llama/13790)

lhez committed 1 year ago

Verified 78e76028

vulkan: use timestamp queries for GGML_VULKAN_PERF (llama/13817)

jeffbolznv committed 1 year ago

Verified 0c6e4fc1

SYCL: add gelu_erf kernel (llama/13749)

qnixsynapse committed 1 year ago

Verified cf971a85

ggml : add ggml_repeat_4d (llama/13824)

ngxson committed 1 year ago

Verified f2df32a4

vulkan : Remove unexpected ; (#1253)

dg0yt committed 1 year ago

Verified 94a83ba5

cmake : Fix broken CMake error messages (#1252)

dg0yt committed 1 year ago

Verified c9883376

ggml : remove ggml_graph_import and ggml_graph_export declarations (#1247)

rgerganov committed 1 year ago

Verified 62042b74

ggml : fix pkg-config include path (#1248)

rgerganov committed 1 year ago

Verified 9d6ac2b3

ggml : skip tests, examples incompatible with GGML_BACKEND_DL (#1242)

ckastner committed 1 year ago

Verified 5592ffda

ci : Add Windows (#1249)

danielzgtg committed 1 year ago

Verified 44ca1653

sync : whisper.cpp (#1250)

ggerganov committed 1 year ago

Verified 29077268

sync : whisper.cpp

ggerganov committed 1 year ago

b2a618ca

ggml : install dynamic backends (#1240)

rgerganov committed 1 year ago

Verified 599c132b

ggml : Print backtrace on uncaught C++ exceptions (#1232)

danielzgtg committed 1 year ago

Verified 7cd89f68

sync : whisper.cpp

ggerganov committed 1 year ago

06b715f4

Older