ggml-org/llama.cpp

Pull Requests Commits
vec move mask to shmem
ggerganov committed 1 year ago
Verified 94accca4
f16 vec
ggerganov committed 1 year ago
Verified 3b962503
clean-up
ggerganov committed 1 year ago
Verified 8f0ef152
remove compile flag
ggerganov committed 1 year ago
Verified 022e5e90
wip
ggerganov committed 1 year ago
Verified a6c8dbfa
int64 dst
ggerganov committed 1 year ago
Verified 4abeb60a
float -> half regs
ggerganov committed 1 year ago
Verified 3ab47eb7
64-bit -> 32-bit
ggerganov committed 1 year ago
Verified e121d82f
remove inner if mask
ggerganov committed 1 year ago
Verified a75cdcca
remove ms array
ggerganov committed 1 year ago
Verified 61d05b57
move mask to shared mem
ggerganov committed 1 year ago
Verified 98492810
wip 5
ggerganov committed 1 year ago
Verified 2aedbb35
wip 4
ggerganov committed 1 year ago
Verified dc2a27f2
wip 3
ggerganov committed 1 year ago
Verified 9bd5ae09
wip2
ggerganov committed 1 year ago
Verified 2335086f
wip
ggerganov committed 1 year ago
Verified 01c7f112
metal : add GGML_METAL_FORCE_FATTN_PREC_F16
ggerganov committed 1 year ago
Verified 0f7e8f38
metal : use F16 precision in FA kernel
ggerganov committed 1 year ago
Verified eefc132b
ggml : add ggml_flash_attn_ext_get_prec
ggerganov committed 1 year ago
Verified 22a9311a
metal : add BF16 support (#8439)
ggerganov committed 1 year ago
Verified 5c333e01
server : remove hack for extra parallel slot (#10187)
ggerganov committed 1 year ago
Verified b11f9ba9
metal : fix from ptr buffer name (#10189)
slaren committed 1 year ago
Verified 94d8cb8b
ggml : adjust is_first_call init value (#10193)
ggerganov committed 1 year ago
Verified 1dc04b2d
metal : add quantized FA support (#10149)
ggerganov committed 1 year ago
Verified a1eaf6a9
llama : add <|tool_call|> formatting to Granite template (#10177)
gabe-l-hart committed 1 year ago
Verified b8deef0e
ggml : fix arch check in bf16_to_fp32 (#10164)
slaren committed 1 year ago
Verified a9e8a9a0
Q6_K AVX improvements (#10118)
netrunnereve committed 1 year ago
Verified 34073647
ggml : fix gelu tables initialization (#10172)
slaren committed 1 year ago
Verified d5a409e5
ggml : fix q4xx mat mul, increase ggml_aligned_malloc alignment (#10167)
slaren committed 1 year ago
Verified 401558b7
server : clarify /slots endpoint, add is_processing (#10162)
ngxson committed 1 year ago
Verified 9e0ecfb6
Terms Of Use Privacy Policy Refund Policy Impressum