ggml-org/llama.cpp

Pull Requests Commits

metal : fix build

ggerganov committed 5 hours ago

Verified 5d458841

Merge pull request #6 from gaugarg-nv/get_host_buffer_type

JohannesGaessler committed 1 day ago

Verified f0198ef6

Support device-specific host buffer types if all underlying backends expose the same type. This allows using pinned memory instead of pageable memory for CUDA.

gaugarg-nv committed 2 days ago

aa8b6210

better granularity estimate

JohannesGaessler committed 4 days ago

fd24533e

fix compilation

JohannesGaessler committed 4 days ago

d8f97b99

arbitrary num. of GPUs/tensor split

JohannesGaessler committed 4 days ago

98ab6727

fix view_offs scaling

JohannesGaessler committed 5 days ago

9c7d45c0

support for tensor dims % n_devs != 0

JohannesGaessler committed 5 days ago

31e4f189

Merge pull request #4 from gaugarg-nv/minor_fixes

JohannesGaessler committed 5 days ago

Verified b12a5635

Apply suggestion from @JohannesGaessler

JohannesGaessler committed 5 days ago

Verified 9bb9d783

Fix the seg fault without NCCL

gaugarg-nv committed 5 days ago

10385e8f

2d tensor set/get support

JohannesGaessler committed 6 days ago

3fdd0b7a

move allocation workaround out of ggml-alloc.c

JohannesGaessler committed 6 days ago

76d94392

Remove shfl and AllReduce from backend interface

JohannesGaessler committed 6 days ago

4dc3d10e

GGML: HIP: add RCCL support

IMbackK committed 6 days ago

29c5327d

JohannesGaessler committed 6 days ago

8de41b5b

fix output pattern

JohannesGaessler committed 6 days ago

c5314444

re-use buffers + ggml contexts

JohannesGaessler committed 6 days ago

c9255634

unconditional peer access

JohannesGaessler committed 6 days ago

02325685

add support for 4/8 GPUs

JohannesGaessler committed 6 days ago

2ffa49de

partial Vulkan fix

JohannesGaessler committed 6 days ago

4b8aa266

support for GPT-OSS, Qwen 3 MoE

JohannesGaessler committed 6 days ago

ab69c58a

ggml: backend-agnostic tensor parallelism

JohannesGaessler committed 6 days ago

a0d9dd20

metal : extend l2_norm support for non-cont src0 (#19502)

ggerganov committed 6 days ago

Verified 9ab072eb

docs: ban AI for issues and discussions [no CI] (#19512)

JohannesGaessler committed 7 days ago

Verified ada90bf2

common : improve download error reporting (#19491)

angt committed 7 days ago

Verified 0c1f39a9

hexagon: Add ARGSORT, DIV, SQR, SQRT, SUM_ROWS, GEGLU (#19406)

max-krasnyansky committed 7 days ago

Verified 73cd5e1b

llama : correct typos 'occured' and 'occurences' (#19414)

thecaptain789 committed 7 days ago

Verified 8ee538ce

model : fix wavtokenizer embedding notions (#19479)

ggerganov committed 7 days ago

Verified 6d957078

ggml : extend bin bcast for permuted src1 (#19484)

ggerganov committed 7 days ago

Verified 89181c0b

Older