PR #20720 Add GQA on CPU in LLaMA scripts

Add GQA on CPU in LLaMA scripts #20720

hanbitmyths merged 6 commits into microsoft:main from kunal-vaishnavi:kvaishnavi/llama-gqa-cpu

Add changes to support GQA for CPU

fc92f7a8

Enable trusting remote code

10750bc2

Set pad token id to EOS token id

4e0738b9

tianleiwu commented on 2024-05-18

tianleiwu dismissed these changes on 2024-05-18

Add GQA for FP32 CPU during optimization

115b8cad

Enable trusting remote code via authentication

8051ef76

Add changes suggested by linter

f0ba1f01

kunal-vaishnavi dismissed their stale review via f0ba1f01 1 year ago

kunal-vaishnavi changed the title ~~Add support for GQA on CPU in LLaMA benchmarking scripts~~ Add GQA on CPU in LLaMA scripts 1 year ago

github-advanced-security commented on 2024-05-18

tianleiwu approved these changes on 2024-05-18

hanbitmyths merged 72a3bde3 into main 1 year ago

Reviewers

tianleiwu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone