microsoft/onnxruntime

Pull Requests Commits

Cheng Tang committed 2 years ago

8b3a185f

install mpi4py in inference

Cheng Tang committed 2 years ago

7715bccd

Cheng Tang committed 2 years ago

5c1cb5c4

use mpirun directly

Cheng Tang committed 2 years ago

5f4905d9

add distributed inference test stage

Cheng Tang committed 2 years ago

8cd8a234

add more tests;fix build options

Cheng Tang committed 2 years ago

5953e9ad

add basic test and fix some bugs

Cheng Tang committed 2 years ago

fa1d083f

allreduce kernel/schema

Cheng Tang committed 2 years ago

27d3365b

Custom Op runtime wrapper (#13427)

adrianlizarraga committed 2 years ago

Verified de17d53c

Fix a security warning in cuda gemm int8 kernel (#14335)

souptc committed 2 years ago

Verified 734ae398

add opset18 node test (#14236)

mszhanyi committed 2 years ago

Verified 8236808e

Fix type mismatch when ORT_ENABLE_STREAM is off (#14324)

skottmckay committed 2 years ago

Verified dab900df

DML EP return clearer error message when users attempt to use software adapter (#14273)

fdwr committed 2 years ago

Verified f6d0598b

[CUDA] Add trt cross attention kernels (#14328)

tianleiwu committed 2 years ago

Verified 477cad30

Support flash attention on 2d attention mask for gpt2 left padding. (#14215)

zhanghuanrong committed 2 years ago

Verified a8df6c35

Clean up TensorRT deprecations, warnings, unbounded string copy (#14148)

adrianlizarraga committed 2 years ago

Verified 30b9f5dd

enable ort-extensions in wasm release builds (#14239)

guschmue committed 2 years ago

Verified 60290393

Add mask_filter in Attention related ops' attribute (#14274)

wangyems committed 2 years ago

Verified 2db57a53

delete unused local typedef VK to fix pipeline error (#14322)

zhijxu-MS committed 2 years ago

Verified caa59005

Fix murmurhash3 inclusion in TensorRT shared library (#14221)

adrianlizarraga committed 2 years ago

Verified 19b4d9d4

fix transformer model unit tests (#14319)

yufenglee committed 2 years ago

Verified c99cd06b

Skip some tests to pass orttraining-gpu with TRT8.5 (#14314)

mszhanyi committed 2 years ago

Verified 909d7f4b

fix roctracer missing nccl operation bug (#14277)

kailums committed 2 years ago

Verified db690793

Removing Double QDQ from Graphs (#14024)

jchen351 committed 2 years ago

Verified d95249f5

Add Cache in Linux CPU Aten Pipeline (#14313)

mszhanyi committed 2 years ago

Verified fb801d58

Compatibility patch for nlohmann/json < 3.9.0. (#12394)

xkszltl committed 2 years ago

Verified 3a9f30df

Fix build error on Windows if Python debug libraries are installed (#14308)

skottmckay committed 2 years ago

Verified 7f374f40

Fix subgraph index issue in TRT (#14305)

stevenlix committed 2 years ago

Verified 49cfb56c

install shared deps script (#14234)

mszhanyi committed 2 years ago

Verified 6d60dc24

ROCm header path updates (#14170)

jeffdaily committed 2 years ago

Verified fe052e60

Older