PR #18337 Add LLaMA GQA ragged batching

Add LLaMA GQA ragged batching #18337

tianleiwu merged 5 commits into microsoft:main from kunal-vaishnavi:kvaishnavi/llama-fix-gqa-batching

Fix GQA ragged batching

7ccec207

Remove GQA left padding fix

645225ec

Add changes suggested by linter

21fd8559

kunal-vaishnavi added release:1.16.2

kunal-vaishnavi added sdxl_llama

Merge branch 'main' into kvaishnavi/llama-fix-gqa-batching

1eabc508

Update README

d1b5511b

tianleiwu requested a review from

frank-dong-ms 2 years ago

yufenglee approved these changes on 2023-11-08

tianleiwu merged c8def0cc into main 2 years ago

tianleiwu commented on 2023-11-08

tianleiwu removed release:1.16.2

tianleiwu removed sdxl_llama

Reviewers

yufenglee

tianleiwu

frank-dong-ms

Assignees

No one assigned

Labels

None yet

Milestone

No milestone