Move Gelu and LayerNorm fusion to L1 optimization #21332
skottmckay
merged
16 commits into
microsoft:main
from
peishenyan:l1_optimize
addGelu and LayerNorm fusion in L1 optimization
df6a319f
peishenyan
changed the title
modify test case
bb0fa6b7
Merge branch 'microsoft:main' into l1_optimize
c93030a4
fix test bugs
c0e7edb4
address comments
a53e9e99
fix bugs
6cf1e84e
add comments
9b4e2046
add test case for GeluFusion with opset=20
dfd82586
skottmckay
dismissed these changes
on 2024-08-12
fix bugs
aa570c85
fix bugs
6bc2a3ea
Merge branch 'microsoft:main' into l1_optimize
9875761a
Merge branch 'l1_optimize' of https://github.com/peishenyan/onnxrunti…
d31f7e35
add contrib_flag for GeluFusion and LayerNormFusion optimizers
ba663d16
skottmckay
commented
on 2024-09-04
address comments
019b4afc
skottmckay
commented
on 2024-09-05
Update orttraining/orttraining/core/optimizer/compute_optimizer/paddi…
17e8d5c1
skottmckay
dismissed these changes
on 2024-09-06
edgchen1
commented
on 2024-09-06
edgchen1
dismissed these changes
on 2024-09-06
Add comments about assumption of optimizers being registered in L1.
b096a8e6
skottmckay
approved these changes
on 2024-09-06
Login to write a write a comment.
Login via GitHub