onnxruntime
[TVM EP] Support zero copying TVM EP output tensor to ONNX Runtime output tensor
#12593

Merged

[TVM EP] Support zero copying TVM EP output tensor to ONNX Runtime output tensor #12593

yuslepukhin merged 9 commits into microsoft:main from octoml:vc/tvm_ep_set_output

vvchernov force pushed from 958dbd83 to 1c1abbdf 3 years ago

vvchernov force pushed from 1c1abbdf to 9e2f5bb0 3 years ago

vvchernov requested a review 3 years ago

vvchernov force pushed from 15bd7ab0 to 7de7c7c9 3 years ago

vvchernov changed the title ~~WIP: [TVM EP] Support zero copying TVM EP output tensor to ONNX Runtime output tensor~~ [TVM EP] Support zero copying TVM EP output tensor to ONNX Runtime output tensor 3 years ago

xadupre commented on 2022-10-05

vvchernov force pushed from 536f9eee to 73f52494 3 years ago

xadupre dismissed these changes on 2022-10-11

yuslepukhin dismissed these changes on 2022-11-04

pranavsharma dismissed these changes on 2022-11-08

vvchernov dismissed their stale review via 8999db53 3 years ago

vvchernov force pushed from 73f52494 to 8999db53 3 years ago

pranavsharma dismissed these changes on 2022-11-15

set_output_zero_copy was added to TVM EP options. it is true by default

5cb30f02

update RunnerImpl API for TVM EP

0b689e9b

GERunnerImpl::set_output_zero_copy() was implemented

1ba78981

VMRunnerImpl::set_output_zero_copy() was implemented

3d9ee6b4

pack output DLTensors to TVMArgs

567fead3

lint fixes

4c0ee897

update API. fix cpp lint

b2c6ab12

update TVM with needed functionality

59e97f1a

renaming

dd9cd9e1

vvchernov dismissed their stale review via dd9cd9e1 3 years ago

vvchernov force pushed from 8999db53 to dd9cd9e1 3 years ago

yuslepukhin approved these changes on 2022-12-19

yuslepukhin merged ba8a00f6 into main 3 years ago

Reviewers

yuslepukhin

xadupre

pranavsharma

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

onnxruntime [TVM EP] Support zero copying TVM EP output tensor to ONNX Runtime output tensor #12593 Merged

[TVM EP] Support zero copying TVM EP output tensor to ONNX Runtime output tensor #12593

onnxruntime
[TVM EP] Support zero copying TVM EP output tensor to ONNX Runtime output tensor
#12593

Merged