PR #21852 [CUDA] enable causal in MultiHeadAttention

[CUDA] enable causal in MultiHeadAttention #21852

tianleiwu merged 2 commits into main from tlwu/mha_causal

causal MHA

8ae33e06

tianleiwu marked this pull request as draft 1 year ago

update mha test

d6f3378c

tianleiwu marked this pull request as ready for review 1 year ago

tianleiwu requested a review from

wangyems 1 year ago

tianleiwu requested a review from

kunal-vaishnavi 1 year ago

tianleiwu requested a review from

yufenglee 1 year ago

wangyems approved these changes on 2024-08-26

kunal-vaishnavi approved these changes on 2024-08-26

tianleiwu merged ad382120 into main 1 year ago

tianleiwu deleted the tlwu/mha_causal branch 1 year ago

Reviewers

kunal-vaishnavi

wangyems

yufenglee

Assignees

No one assigned

Labels

None yet

Milestone

No milestone