PR #18337 Add LLaMA GQA ragged batching

Fix GQA ragged batching

kunal-vaishnavi committed 2 years ago

Remove GQA left padding fix

kunal-vaishnavi committed 2 years ago

Add changes suggested by linter

kunal-vaishnavi committed 2 years ago

Merge branch 'main' into kvaishnavi/llama-fix-gqa-batching

kunal-vaishnavi committed 2 years ago

Update README

kunal-vaishnavi committed 2 years ago

onnxruntime Add LLaMA GQA ragged batching #18337 Merged