ggerganov/llama.cpp

Pull Requests Commits

rpc-server : allow iGPU

slaren committed 13 hours ago

df2f47c8

mtmd : allow iGPU

slaren committed 13 hours ago

c8014a95

llama : allow using iGPUs with --device

slaren committed 14 hours ago

9f7504d1

server : adjust prompt similarity thold + add logs (#15913)

ggerganov committed 15 hours ago

Verified f088b6a8

Vulkan iGPU device selection overhaul and PCI ID API support (#15947)

0cc4m committed 18 hours ago

Verified 304ac569

vulkan: Make device memory check more portable (#15939)

mbaudier committed 22 hours ago

Verified 6c88ad8f

Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910)

NeoZhangJianyu committed 1 day ago

Verified 704d90c9

ggml-backend : add GGML_BACKEND_DEVICE_TYPE_IGPU device type (#15797)

slaren committed 1 day ago

Verified 360d6533

CUDA: larger SRAM reads for tile FA, AMD FP16 dot (#15927)

JohannesGaessler committed 1 day ago

Verified 0e6ff004

nitpick : correct MB to MiB (#15934)

ddh0 committed 1 day ago

Verified df082f56

ggml-cpu : add check for ARM MATMUL_INT8/i8mm support (#15922)

danbev committed 1 day ago

Verified 24a6734d

kleidiai: fix GGML_ASSERT(*cur_backend_id != -1) failed (#15614)

chaxu01 committed 1 day ago

Verified 2b3efea9

CANN: Disable acl_graph for prefill stage (#15933)

hipudding committed 1 day ago

Verified c0389dba

CUDA: Add `fastdiv` to `k_bin_bcast*`, giving 1-3% E2E performance (#15872)

ORippler committed 2 days ago

Verified 00681dfc

llama : support T5 models with unequal number of encoder-decoder layers (#15909)

DamonFool committed 2 days ago

Verified 4f658855

graph : support non-contiguous Q in build_attn_mha (#15908)

CISC committed 2 days ago

Verified 6ab397e1

ggml-cpu : fix padding in ggml_timestep_embedding (#15917)

danbev committed 2 days ago

Verified 9de447d9

metal : make the backend async (#15906)

ggerganov committed 2 days ago

Verified 0f0a3c28

ci : add caching for ROCm installation in release workflow (#15924)

danbev committed 2 days ago

Verified 33daece8

tests : filter out no-ops from coverage report (#15900)

danbev committed 2 days ago

Verified e7b6d83b

media : add transparent icon svg and png [no ci] (#15891)

06kellyjac committed 2 days ago

Verified 2cfef4d1

gitignore : Ignore vim swap files in tests (#15901)

createthis committed 2 days ago

Verified 09e72a03

CANN: Add ROPE sin/cos cache for reuse (#15912)

noemotiovon committed 2 days ago

Verified 10d8b2b6

CANN: implement LRU cache for ACL graphs (#15814)

noemotiovon committed 2 days ago

Verified 28b5f190

llama : check returned fn ptrs from ggml_backend_reg_get_proc_address (#15893)

danbev committed 3 days ago

Verified 86587da0

ci : cache ROCm installation in windows-latest-cmake-hip (#15887)

danbev committed 3 days ago

Verified ff02caf9

vulkan: throw the oom error instead of no memory type found (#15905)

0cc4m committed 3 days ago

Verified ae355f6f

vulkan: Fix OOB accesses in soft_max_back (#15861)

jeffbolznv committed 3 days ago

Verified 4f63cd70

HIP: use v_dot2_f32_f16 instruction for FA (#15884)

JohannesGaessler committed 3 days ago

Verified 17bc5a81

Workaround for subgroup arithmetic failing on MoltenVK with AMD GPUs (issue 15846) (#15886)

lksj92hs committed 3 days ago

Verified ed54e325

Older