ggerganov/llama.cpp

Pull Requests Commits
metal : fix build
ggerganov committed 59 days ago
Verified 5d458841
Merge pull request #6 from gaugarg-nv/get_host_buffer_type
JohannesGaessler committed 61 days ago
Verified f0198ef6
Support device-specific host buffer types if all underlying backends expose the same type. This allows using pinned memory instead of pageable memory for CUDA.
gaugarg-nv committed 61 days ago
aa8b6210
better granularity estimate
JohannesGaessler committed 64 days ago
fd24533e
fix compilation
JohannesGaessler committed 64 days ago
d8f97b99
arbitrary num. of GPUs/tensor split
JohannesGaessler committed 64 days ago
98ab6727
fix view_offs scaling
JohannesGaessler committed 64 days ago
9c7d45c0
support for tensor dims % n_devs != 0
JohannesGaessler committed 65 days ago
31e4f189
Merge pull request #4 from gaugarg-nv/minor_fixes
JohannesGaessler committed 65 days ago
Verified b12a5635
Apply suggestion from @JohannesGaessler
JohannesGaessler committed 65 days ago
Verified 9bb9d783
Fix the seg fault without NCCL
gaugarg-nv committed 65 days ago
10385e8f
2d tensor set/get support
JohannesGaessler committed 66 days ago
3fdd0b7a
move allocation workaround out of ggml-alloc.c
JohannesGaessler committed 66 days ago
76d94392
Remove shfl and AllReduce from backend interface
JohannesGaessler committed 66 days ago
4dc3d10e
GGML: HIP: add RCCL support
IMbackK committed 66 days ago
29c5327d
NCCL support
JohannesGaessler committed 66 days ago
8de41b5b
fix output pattern
JohannesGaessler committed 66 days ago
c5314444
re-use buffers + ggml contexts
JohannesGaessler committed 66 days ago
c9255634
unconditional peer access
JohannesGaessler committed 66 days ago
02325685
add support for 4/8 GPUs
JohannesGaessler committed 66 days ago
2ffa49de
partial Vulkan fix
JohannesGaessler committed 66 days ago
4b8aa266
support for GPT-OSS, Qwen 3 MoE
JohannesGaessler committed 66 days ago
ab69c58a
ggml: backend-agnostic tensor parallelism
JohannesGaessler committed 66 days ago
a0d9dd20
metal : extend l2_norm support for non-cont src0 (#19502)
ggerganov committed 66 days ago
Verified 9ab072eb
docs: ban AI for issues and discussions [no CI] (#19512)
JohannesGaessler committed 66 days ago
Verified ada90bf2
common : improve download error reporting (#19491)
angt committed 66 days ago
Verified 0c1f39a9
hexagon: Add ARGSORT, DIV, SQR, SQRT, SUM_ROWS, GEGLU (#19406)
max-krasnyansky committed 66 days ago
Verified 73cd5e1b
llama : correct typos 'occured' and 'occurences' (#19414)
thecaptain789 committed 66 days ago
Verified 8ee538ce
model : fix wavtokenizer embedding notions (#19479)
ggerganov committed 66 days ago
Verified 6d957078
ggml : extend bin bcast for permuted src1 (#19484)
ggerganov committed 66 days ago
Verified 89181c0b
Terms Of Use Privacy Policy Refund Policy Impressum