Multi-GPU Kineto profiler test (#51391)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/51391
Adding a test to check the kineto profiler on multiple gpus
Test Plan: python test/test_profiler.py
Reviewed By: ngimel
Differential Revision: D26160788
Pulled By: ilia-cher
fbshipit-source-id: f3554f52176cc26e7f331d205f1a514eb03aa758