pytorch
d36c284d - [triton] allow cuda properties to be queried from workers (#87101)

Commit
2 years ago
[triton] allow cuda properties to be queried from workers (#87101) Fixes https://github.com/pytorch/pytorch/pull/87048 by saving the needed properties before fork. Actually attempting to get CUDA to load in the workers is probably not desired: cuda initialization takes O(seconds). Having multiple processes using the same device will slow things down. This just moves the needed properties from the main trainer process to the workers. Pull Request resolved: https://github.com/pytorch/pytorch/pull/87101 Approved by: https://github.com/soumith
Author
Committer
Parents
Loading