PR #25161 [CUDA] bfloat16 MatMulNBits

[CUDA] bfloat16 MatMulNBits #25161

tianleiwu merged 3 commits into main from tlwu/matmul_nbits_bf16

tianleiwu marked this pull request as draft 214 days ago

support bf16 in MatMulNBits

e6190236

tianleiwu force pushed from b46441f7 to e6190236 213 days ago

github-actions commented on 2025-06-26

fix test

7a39e01b

tianleiwu marked this pull request as ready for review 213 days ago

use intrinsic for bf16 to bf162

c95b016f

tianleiwu requested a review from

nenad1002 213 days ago

tianleiwu requested a review from

kunal-vaishnavi 213 days ago

tianleiwu requested a review from

jiafatom 213 days ago

nenad1002 commented on 2025-06-26

kunal-vaishnavi commented on 2025-06-26

kunal-vaishnavi approved these changes on 2025-06-26

tianleiwu merged 7fdd3863 into main 212 days ago

tianleiwu deleted the tlwu/matmul_nbits_bf16 branch 212 days ago

Reviewers

kunal-vaishnavi

nenad1002

github-actions

jiafatom

Assignees

No one assigned

Labels

None yet

Milestone

No milestone