PR #9284 Add Transpose Optimizer and modify nhwc optimizer to use it.

TomWildenhain-Microsoft force pushed from 1a77c172 to 5d9db845 4 years ago

TomWildenhain-Microsoft force pushed from 5d9db845 to 1ff323fe 4 years ago

Add Transpose Optimizer and modify nhwc optimizer to use it.

48d7dd85

TomWildenhain-Microsoft force pushed from 1ff323fe to 48d7dd85 4 years ago

Fix casts

2fd8b3d2

Fix casts2

24cc888f

Fix move

e8da408e

yuslepukhin commented on 2021-10-07

TomWildenhain-Microsoft changed the title ~~Add Transpose Optimizer and modify nhwc optimizer to use it.~~ [WIP] Add Transpose Optimizer and modify nhwc optimizer to use it. 4 years ago

yuslepukhin commented on 2021-10-07

Add tests

3aeca4d3

Add headers

54927c00

TomWildenhain-Microsoft requested a review from

skottmckay 4 years ago

Fixes and tests

2fcc860d

Remove explicit template instantiation

6740edce

Fix build warning

f1cf11c1

Name unit tests

5759a6c8

skottmckay commented on 2021-10-08

skottmckay commented on 2021-10-11

Code review fixes

f4396d82

Add some comments

b0a7d622

Fix some casts

ff56fe28

Make optimization slightly less agressive

8758851f

Some unit test fixes

265c9d40

Update Attention pattern to work with transpose optimizer

8ede2115

Update attention fuser

6de3e403

Fix attention fusion python script

623741af

Improve transpose optimizer documentation

a63b8923

Merge branch 'microsoft:master' into tom/transpose_optimizer

2ef3b303

Create OptimizerCtx struct

594eca0b

Merge branch 'tom/transpose_optimizer' of https://github.com/TomWilde…

db3ea5db

TomWildenhain-Microsoft force pushed from 432d3da1 to 7031dd9d 4 years ago

Disable Slice handler for testing

bf4472cd

TomWildenhain-Microsoft force pushed from 7031dd9d to bf4472cd 4 years ago

Implement Slice int32

27ec2cd4

Only push transposes leading up to other transposes

1352a881

Improve optimization heuristic

24177f8c

TomWildenhain-Microsoft force pushed from 44934c18 to 24177f8c 4 years ago

Add exemption for MaxPool

64cc4484

TomWildenhain-Microsoft force pushed from f3de9735 to d7790ce3 4 years ago

Document transpose optimizer api.h

6c48036a

TomWildenhain-Microsoft force pushed from d7790ce3 to 6c48036a 4 years ago

Revert fusion tests to master

fcaae476

Remove temp files

a4938c2b

Replace typedef with using

3299b0ab

Trim trailing whitespace

983e926e

Move class declarations from api_impl.h to api_impl.cc

0a1004e5

Remove copy constructors and move allocator

dd25b0cf

TomWildenhain-Microsoft force pushed from a599ba10 to dd25b0cf 4 years ago

Alphabetize headers

784e6502

Add override keyword

f6afe2df

Comments for nhwc_transformer

c0f81ef2

Rename OrtGraph to ApiGraph, etc.

d2441736

Wrap line

92db5055

Remove extra qualifier on ApiGraph

cf470f5d

Refector attention fusion

43ff2817

TomWildenhain-Microsoft force pushed from aee7a408 to 43ff2817 4 years ago

Remove c-style casts from api_impl.cc

bd116e43

Improve documentation

6ce146ac

Avoid printing vector in ORT_ENSURES

09559156

Revert attention fusion refactor

cd545637

Remove duplicate cost heuristics and improve documentation

9ec43db4

skottmckay commented on 2021-10-21

Fix size_t casts

6efc368c

Fixes from Scott's review

9c215c08

skottmckay commented on 2021-10-22

Unrevert attention refactor and more updates from Scott's review

3498da07

skottmckay commented on 2021-10-22

Revert api_impl.cc ValueInfo change

7cd1e502

only optimize first transpose input

523bfedc

Unrevert api_impl.cc changes

34f68429

Make vector call reserve

2e8ef1f9

skottmckay commented on 2021-10-25

transpose_optimizer.cc update from Scott's comments

abb49224

Rename api::Graph to api::GraphRef etc.

22d3f40a

Consider domains 'onnx.ai' and '' equal

7d1a17be

Replace AddInput with SetInput

af5732c0

Improve tests

a26f60ac

quantization and heuristic tests

2427c715

edgchen1 commented on 2021-10-26

Comments for tests

6fab4458

edgchen1 commented on 2021-10-26

Replace const string_view with string_view and update tests

d2c8ef88

edgchen1 commented on 2021-10-26

Fixes requested by Edward

2ee62f02

edgchen1 commented on 2021-10-26

Fix std::string to string_view conversion

5c221eeb

Add <string> to includes

7326c5a8

TomWildenhain-Microsoft changed the title ~~[WIP] Add Transpose Optimizer and modify nhwc optimizer to use it.~~ Add Transpose Optimizer and modify nhwc optimizer to use it. 4 years ago

Fix bug for broadcasting ops with unknown rank. Slight safety improve…

d2fb66a1

Merge branch 'microsoft:master' into tom/transpose_optimizer

19eed394

edgchen1 commented on 2021-10-27

Changes requested by Edward

4bfed409

edgchen1 commented on 2021-10-27

Fix formatting

3e6ab32c

Improve description of cost metric

36290385

TomWildenhain-Microsoft force pushed from a335daee to 36290385 4 years ago

skottmckay approved these changes on 2021-10-28

edgchen1 approved these changes on 2021-10-28

TomWildenhain-Microsoft merged e8268c9a into master 4 years ago

onnxruntime
Add Transpose Optimizer and modify nhwc optimizer to use it.
#9284

Merged

Add Transpose Optimizer and modify nhwc optimizer to use it. #9284

onnxruntime Add Transpose Optimizer and modify nhwc optimizer to use it. #9284 Merged

Add Transpose Optimizer and modify nhwc optimizer to use it. #9284

onnxruntime
Add Transpose Optimizer and modify nhwc optimizer to use it.
#9284

Merged