[refactor] apply qk norm in attention processors #9071
apply qk norm in attention processors
c90c86f5
yiyixuxu
requested changes
on 2024-08-04
revert attention processor
0018fc4c
qk-norm in only attention proc 2.0 and fused variant
d1d995f6
Merge branch 'main' into attention-qk-norm
f7f99279
Merge branch 'main' into attention-qk-norm
4749f8bb
yiyixuxu
approved these changes
on 2024-08-04
yiyixuxu
approved these changes
on 2024-08-04
yiyixuxu
merged
2b760996
into main 1 year ago
a-r-r-o-w
deleted the attention-qk-norm branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub