[Core] fix QKV fusion for attention #8829
sayakpaul
merged
19 commits into
main
from
fix-qkv-fusion
start debugging the problem,
3dceb84a
start
a352a67c
fix
77ab5452
fix
2ee335f8
fix imports.
ddcc102f
handle hunyuan
8f461772
remove residuals.
ee390076
Merge branch 'main' into fix-qkv-fusion
a7747213
add a check for making sure there's appropriate procs.
be3adcf7
Merge branch 'main' into fix-qkv-fusion
991cc567
Merge branch 'main' into fix-qkv-fusion
15759732
add more rigor to the tests.
eb94d4f4
fix test
ce67fe8b
yiyixuxu
commented
on 2024-07-19
remove redundant check
d563b9ea
fix-copies
8214c886
yiyixuxu
commented
on 2024-07-19
Merge branch 'main' into fix-qkv-fusion
09741b00
move check_qkv_fusion_matches_attn_procs_length and check_qkv_fusion_…
81caa930
Merge branch 'main' into fix-qkv-fusion
e4b14dbe
yiyixuxu
approved these changes
on 2024-07-23
Merge branch 'main' into fix-qkv-fusion
8fa4a099
Login to write a write a comment.
Login via GitHub