onnxruntime
7f293d06 - Remove some D2D memcpy in T5 BeamSearch (#15706)

Commit
3 years ago
Remove some D2D memcpy in T5 BeamSearch (#15706) ### Description <!-- Describe your changes. --> replace D2D memcpy with cuda kernels in creating decoder initial feeds before: ![image](https://user-images.githubusercontent.com/52801275/234746326-209110e3-1cd4-4e8c-a488-515dd34c06c7.png) after: ![image](https://user-images.githubusercontent.com/52801275/234736352-0bd027a0-e382-47d7-a1c5-ae9fbc9f1c9d.png) ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> --------- Co-authored-by: Ubuntu <wy@v100-2.0cdb2e52twzevn1i4fi45bylyg.jx.internal.cloudapp.net>
Author
Parents
Loading