pytorch
75c0e3a4 - [MPS] Improve memory usage and performance utilizing garbage collector and adaptive commit (#86119)

Commit
2 years ago
[MPS] Improve memory usage and performance utilizing garbage collector and adaptive commit (#86119) - Improve memory usage and performance utilizing garbage collector and adaptive commit - Enable low watermark limit to detect memory pressure. - Enable garbage collection and adaptive commit strategies when under memory pressure. - More efficient resource management by splitting large heaps (instead of reusing oversized buffers for smaller allocation requests) - Introduce Extra Large heaps to improve performance by avoiding numerous costly allocation of smaller heaps - Fix purgeability when releasing the Metal heaps - Fix the race condition when deferring the heap's size update Fixes #79283 Pull Request resolved: https://github.com/pytorch/pytorch/pull/86119 Approved by: https://github.com/kulinseth, https://github.com/malfet
Author
Committer
Parents
Loading