PR #16075 Add non qkv biased version mha unittests

Add non qkv biased version mha unittests #16075

cloudhan merged 4 commits into main from guangyunhan/non-biased-mha-tests

cloudhan requested a review from

tianleiwu 3 years ago

cloudhan requested a review from

gh-yewang 3 years ago

cloudhan requested a review from

kunal-vaishnavi 3 years ago

cloudhan requested a review from

yufenglee 3 years ago

cloudhan force pushed from 24c73d6d to d0464c4c 3 years ago

cloudhan force pushed from d0464c4c to 2100a4f7 3 years ago

tianleiwu commented on 2023-05-25

kunal-vaishnavi commented on 2023-05-25

cloudhan force pushed from 2100a4f7 to 4093f185 3 years ago

cloudhan requested a review from

kunal-vaishnavi 3 years ago

cloudhan requested a review from

tianleiwu 3 years ago

Allow CUDA MHA to support inputs without qkv_bias

83ae9f7b

Allow CPU MHA to support inputs without qkv_bias

a7140109

Add tests without qkv_bias

0edd76e4

Fix Invalid rank for input: query Got: 4 Expected: 3 Please fix eithe…

fc413a41

cloudhan force pushed from 4093f185 to fc413a41 3 years ago

tianleiwu commented on 2023-06-01

tianleiwu approved these changes on 2023-06-02

cloudhan merged f0139658 into main 3 years ago

cloudhan deleted the guangyunhan/non-biased-mha-tests branch 3 years ago

Reviewers

tianleiwu

kunal-vaishnavi

gh-yewang

yufenglee

Assignees

No one assigned

Labels

None yet

Milestone

No milestone