llama.cpp
vulkan: Add bfloat16 support
#12554
Merged

vulkan: Add bfloat16 support #12554

0cc4m merged 4 commits into ggml-org:master from jeffbolznv:bfloat16_rebase
jeffbolznv
jeffbolznv jeffbolznv requested a review from 0cc4m 0cc4m 351 days ago
github-actions github-actions added Vulkan
github-actions github-actions added ggml
jeffbolznv
jeffbolznv
jeffbolznv commented on 2025-03-24
jeffbolznv jeffbolznv force pushed 343 days ago
jeffbolznv
jeffbolznv jeffbolznv force pushed 343 days ago
jeffbolznv jeffbolznv force pushed 333 days ago
jeffbolznv vulkan: Add bfloat16 support
5f1bb0f8
jeffbolznv vulkan: Support bf16 tensors without the bf16 extension or coopmat su…
60b5d31c
jeffbolznv vulkan: bfloat16 fixes (really works without bfloat16 support now)
2917cada
jeffbolznv vulkan: fix spirv-val failure and reenable -O
83771ecb
jeffbolznv jeffbolznv force pushed to 83771ecb 322 days ago
jeffbolznv jeffbolznv changed the title Draft: vulkan: Add bfloat16 support vulkan: Add bfloat16 support 322 days ago
jeffbolznv
0cc4m
0cc4m approved these changes on 2025-05-01
0cc4m 0cc4m merged 79f26e9e into master 313 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone