ggerganov/llama.cpp

Pull Requests Commits
vec move mask to shmem
ggerganov committed 336 days ago
Verified 94accca4
f16 vec
ggerganov committed 336 days ago
Verified 3b962503
clean-up
ggerganov committed 336 days ago
Verified 8f0ef152
remove compile flag
ggerganov committed 336 days ago
Verified 022e5e90
wip
ggerganov committed 336 days ago
Verified a6c8dbfa
int64 dst
ggerganov committed 336 days ago
Verified 4abeb60a
float -> half regs
ggerganov committed 336 days ago
Verified 3ab47eb7
64-bit -> 32-bit
ggerganov committed 336 days ago
Verified e121d82f
remove inner if mask
ggerganov committed 336 days ago
Verified a75cdcca
remove ms array
ggerganov committed 336 days ago
Verified 61d05b57
move mask to shared mem
ggerganov committed 336 days ago
Verified 98492810
wip 5
ggerganov committed 336 days ago
Verified 2aedbb35
wip 4
ggerganov committed 336 days ago
Verified dc2a27f2
wip 3
ggerganov committed 337 days ago
Verified 9bd5ae09
wip2
ggerganov committed 337 days ago
Verified 2335086f
wip
ggerganov committed 337 days ago
Verified 01c7f112
metal : add GGML_METAL_FORCE_FATTN_PREC_F16
ggerganov committed 337 days ago
Verified 0f7e8f38
metal : use F16 precision in FA kernel
ggerganov committed 337 days ago
Verified eefc132b
ggml : add ggml_flash_attn_ext_get_prec
ggerganov committed 337 days ago
Verified 22a9311a
metal : add BF16 support (#8439)
ggerganov committed 337 days ago
Verified 5c333e01
server : remove hack for extra parallel slot (#10187)
ggerganov committed 337 days ago
Verified b11f9ba9
metal : fix from ptr buffer name (#10189)
slaren committed 337 days ago
Verified 94d8cb8b
ggml : adjust is_first_call init value (#10193)
ggerganov committed 337 days ago
Verified 1dc04b2d
metal : add quantized FA support (#10149)
ggerganov committed 337 days ago
Verified a1eaf6a9
llama : add <|tool_call|> formatting to Granite template (#10177)
gabe-l-hart committed 338 days ago
Verified b8deef0e
ggml : fix arch check in bf16_to_fp32 (#10164)
slaren committed 339 days ago
Verified a9e8a9a0
Q6_K AVX improvements (#10118)
netrunnereve committed 339 days ago
Verified 34073647
ggml : fix gelu tables initialization (#10172)
slaren committed 339 days ago
Verified d5a409e5
ggml : fix q4xx mat mul, increase ggml_aligned_malloc alignment (#10167)
slaren committed 339 days ago
Verified 401558b7
server : clarify /slots endpoint, add is_processing (#10162)
ngxson committed 339 days ago
Verified 9e0ecfb6
Terms Of Use Privacy Policy Refund Policy Impressum