llama.cpp
vulkan: add fp8 and scaled matmul support
#29791
Open

vulkan: add fp8 and scaled matmul support #29791

0cc4m wants to merge 1 commit into 0cc4m/fp8-scaled-mm from 0cc4m/fp8-scaled-mm-vulkan
0cc4m
github-actions github-actions added Vulkan
github-actions github-actions added ggml
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 672af957 to 5858f054 15 days ago
ORippler ORippler force pushed from 90805526 to a73662dd 15 days ago
ORippler ORippler force pushed from a73662dd to f35e9805 15 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 5858f054 to 675729f0 15 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 675729f0 to 7ea0d0b6 15 days ago
ORippler ORippler force pushed from f35e9805 to ab6a7c7d 15 days ago
ORippler ORippler force pushed from ab6a7c7d to 91bbee49 15 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 7ea0d0b6 to cca75601 15 days ago
ORippler ORippler force pushed from 91bbee49 to fb14be8b 15 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from cca75601 to 440d74a8 15 days ago
ORippler ORippler force pushed from fb14be8b to 8968888e 15 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 440d74a8 to 07b89858 15 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 07b89858 to 9a828bdd 14 days ago
ORippler ORippler force pushed from 8968888e to 57673f52 14 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 9a828bdd to b8a4e2cb 14 days ago
ORippler ORippler force pushed from 57673f52 to 7915c878 14 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from b8a4e2cb to 7be59da2 7 days ago
ORippler ORippler force pushed from 7915c878 to 8b00ad79 7 days ago
ORippler ORippler force pushed from 8b00ad79 to 472d49f7 3 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 7be59da2 to d3ea927f 3 days ago
ORippler ORippler force pushed from 472d49f7 to 69d00066 3 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from d3ea927f to 7cd37056 3 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 7cd37056 to a7ff904e 3 days ago
ORippler ORippler force pushed from 69d00066 to 1c05f721 3 days ago
ORippler ORippler force pushed from 1c05f721 to a16682d7 3 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from a7ff904e to 6ceb1dfc 3 days ago
ORippler ORippler force pushed from a16682d7 to bf51e083 2 days ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 6ceb1dfc to 9084618b 2 days ago
ORippler ORippler force pushed from bf51e083 to e377c0ed 1 day ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 9084618b to 5a3486df 1 day ago
ORippler ORippler force pushed from e377c0ed to efd9e5d7 1 day ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 5a3486df to b9bdd103 1 day ago
ORippler ORippler force pushed from efd9e5d7 to dc42f810 1 day ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from b9bdd103 to 10028cf7 1 day ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 10028cf7 to 5bb7d7fa 1 day ago
ORippler ORippler force pushed from dc42f810 to 2b446d94 1 day ago
ORippler ORippler force pushed from 2b446d94 to 329c8bf0 1 day ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 5bb7d7fa to 22d59e91 1 day ago
ORippler ORippler force pushed from 329c8bf0 to 7ccfd459 10 hours ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 22d59e91 to 31ff37c6 10 hours ago
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 31ff37c6 to 0de747f4 6 hours ago
ORippler ORippler force pushed from 7ccfd459 to 6f5191bc 6 hours ago
0cc4m vulkan: add fp8 and scaled matmul support
77fc6f6c
ORippler ORippler force-pushed the 0cc4m/fp8-scaled-mm branch from 0de747f4 to a06027dc 6 hours ago
ORippler ORippler force pushed from 6f5191bc to 77fc6f6c 6 hours ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone