PR #19801 Fix GQA Rotary Embedding sequence length

Fix GQA Rotary Embedding sequence length #19801

aciddelgado merged 1 commit into main from aciddelgado/fix_rotary_gqa

modify rotary cache dim check

b43de5ef

aciddelgado requested a review from

kunal-vaishnavi 2 years ago

aciddelgado requested a review from

yufenglee 2 years ago

kunal-vaishnavi approved these changes on 2024-03-06

aciddelgado merged 8bd1335d into main 2 years ago

aciddelgado deleted the aciddelgado/fix_rotary_gqa branch 2 years ago

kunal-vaishnavi added release:1.17.3

Reviewers

kunal-vaishnavi

yufenglee

Assignees

No one assigned

Labels

release:1.17.3

Milestone

No milestone