pytorch
5b767d40 - Modified roundup_power2_divisions to specify the number of divisions for each power of two interval (#87290)

Commit
2 years ago
Modified roundup_power2_divisions to specify the number of divisions for each power of two interval (#87290) Summary: Improved roundup_power2_divisions knob so it allows better control of rouding in the PyTorch CUDA Caching Allocator. This new version allows setting the number of divisions per power of two interval starting from 1MB and ending at 64GB and above. An example use case is when rouding is desirable for small allocations but there are also very large allocations which are persistent, thus would not benefit from rounding and take up extra space. Test Plan: Tested locally Differential Revision: D40103909 Pull Request resolved: https://github.com/pytorch/pytorch/pull/87290 Approved by: https://github.com/zdevito
Author
Committer
Parents
Loading