Adjust CUDA memory leak test (#40504)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/40504
Make CUDA mem liek test not flaky
Test Plan: python test/test_profiler.py
Differential Revision: D22215527
Pulled By: ilia-cher
fbshipit-source-id: 5f1051896342ac50cd3a21ea86ce7487b5f82a19
