PR #17890 Add MatMul 4bits support on GPU

Add MatMul 4bits support on GPU #17890

yufenglee merged 1 commit into main from yufeng/matmul_int4_gpu

yufenglee requested a review from

chenfucn 2 years ago

yufenglee requested a review from

zhanghuanrong 2 years ago

yufenglee requested a review from

edgchen1 2 years ago

yufenglee requested a review from

tianleiwu 2 years ago

yufenglee force pushed from df1b455c to 2a5be5e6 2 years ago

yufenglee force pushed from 2a5be5e6 to 4131d145 2 years ago

Add MatMul 4bits support on GPU

8badbcc2

yufenglee force pushed from 4131d145 to 8badbcc2 2 years ago

jywu-msft requested a review from

adrianlizarraga 2 years ago

tianleiwu commented on 2023-10-12

zhanghuanrong commented on 2023-10-13

zhanghuanrong approved these changes on 2023-10-13

tianleiwu approved these changes on 2023-10-13

tianleiwu commented on 2023-10-13

yufenglee merged 11af3444 into main 2 years ago

yufenglee deleted the yufeng/matmul_int4_gpu branch 2 years ago

yufenglee added release:1.16.2

faxu added triage:approved

faxu added sdxl_llama

tianleiwu removed triage:approved

tianleiwu removed release:1.16.2

tianleiwu removed sdxl_llama

Reviewers

tianleiwu

zhanghuanrong

chenfucn

edgchen1

adrianlizarraga

Assignees

No one assigned

Labels

None yet

Milestone

No milestone