microsoft/onnxruntime

Pull Requests Commits

fs-eire committed 1 year ago

a25103ee

Uncomment present_sequence_length

satyajandhyala committed 1 year ago

8149d92b

satyajandhyala committed 1 year ago

17953997

satyajandhyala committed 1 year ago

5a71a448

satyajandhyala committed 1 year ago

50f5795d

satyajandhyala committed 1 year ago

8e382472

The softmax computation for GQA is not as simple as that of Attention/MHA

satyajandhyala committed 1 year ago

4eb7f432

satyajandhyala committed 1 year ago

e85da0a6

satyajandhyala committed 1 year ago

80a2b1a2

Added GroupQueryAttentionAttr

satyajandhyala committed 1 year ago

5f43e4ab

Revert "Clean up 2"

satyajandhyala committed 1 year ago

2f81b6bf

Revert "Format"

satyajandhyala committed 1 year ago

26e551ac

Revert "Ignore total_sequence_length input as it is not used"

satyajandhyala committed 1 year ago

63850739

Ignore total_sequence_length input as it is not used

satyajandhyala committed 1 year ago

6a864f78

satyajandhyala committed 1 year ago

f0246ab6

satyajandhyala committed 1 year ago

6ef33ae8

satyajandhyala committed 1 year ago

e52a0f7b

Fixed expected output shape and data to match wasm

satyajandhyala committed 1 year ago

cdad003c

convert the result of the division to unsigned int before multiplying

satyajandhyala committed 1 year ago

a2bd3c9b

Convert workdgroup_id.z to absKvHeadIdx of key/value offset calculations

satyajandhyala committed 1 year ago

0a4c0aa8

Use ternary operator instead of if-else

satyajandhyala committed 1 year ago

4f4e8a61

Reverted changes added for debugging

satyajandhyala committed 1 year ago

36075875

Merge branch 'main' of github.com:microsoft/onnxruntime into sajandhy/webgpu_group_query_attention_update

satyajandhyala committed 1 year ago

e30d26d8

Formatting changes.

satyajandhyala committed 1 year ago

c7cee09d

JSONC formatting changes.

satyajandhyala committed 1 year ago

bb27e4f1

Added a comment

satyajandhyala committed 1 year ago

127f20d0

[CUDA] Update Docker to use Ubuntu 24.04, cuda 12.6, cudnn 9.4 and python 3.12 (#22339)

tianleiwu committed 1 year ago

Verified 8595e56d

Stop publishing python 3.8/3.9 packages (#22343)

Changming Sun committed 1 year ago

Verified d9834096

Fix Memory Issue GQA CPU Rotary (#22290)

aciddelgado committed 1 year ago

Verified cc0193cd

Added new testcases.

satyajandhyala committed 1 year ago

82bfde5b

Older