onnxruntime
067b1544 - Skip node output dump for MemcpyToHost (#25651)

Commit
334 days ago
Skip node output dump for MemcpyToHost (#25651) Fix node output dump for MemcpyToHost. The statistics data is not correct, since data might not be copied to CPU yet: ``` MemcpyToHost node: Memcpy_token_232 Input 0 Name: /model/layers.6/moe/router/Add/output_0_CUDAExecutionProvider Shape: {1,1,32} OrtMemoryInfo:[name:Cuda OrtMemType:0 OrtAllocatorType:1 Device:[DeviceType:1 MemoryType:0 VendorId:4318 DeviceId:0 Alignment:0]] Min=-2.5136719,Max=1.6914062 ----------- Output 0 Name: /model/layers.6/moe/router/Add/output_0 Shape: {1,1,32} Min=-4888,Max=6672,NaN=2 ``` This fix will skip the output dump (or statistics) like ``` ----------- Output 0 Name: /model/layers.6/moe/router/Add/output_0 Shape: {1,1,32} is same as input ```
Author
Parents
Loading