PR #23599 [CUDA] Fix beam search of num_beams > 32

[CUDA] Fix beam search of num_beams > 32 #23599

tianleiwu merged 3 commits into main from tlwu/fix_beam_search_topk_scores

fix beam search scores for num_beams > 32

ad17633f

Add tests

7fb3c264

tianleiwu requested a review from

RyanUnderhill 1 year ago

tianleiwu requested a review from

yufenglee 1 year ago

tianleiwu requested a review from

kunal-vaishnavi 1 year ago

update comments

6368b87a

RyanUnderhill approved these changes on 2025-02-06

kunal-vaishnavi approved these changes on 2025-02-06

tianleiwu merged 09e5724f into main 1 year ago

tianleiwu deleted the tlwu/fix_beam_search_topk_scores branch 1 year ago

Reviewers

kunal-vaishnavi

RyanUnderhill

yufenglee

Assignees

No one assigned

Labels

None yet

Milestone

No milestone