Skip memory leak for sam_fast (#2402)
Summary:
Until https://github.com/pytorch/benchmark/issues/2399 is resolved
Pull Request resolved: https://github.com/pytorch/benchmark/pull/2402
Reviewed By: xuzhao9
Differential Revision: D60557916
Pulled By: kit1980
fbshipit-source-id: 5729dd8842c0b817e5265c0a1e816af76d37c632
