Add SAM (#1661)
Summary:
This is an E2E pipeline for SAM with real weights and real data so compiling the whole thing end to end will be informative, it's also a good study for looking at decoding and data loading
TODO
* [x] Make batch size configurable - N/A because the predictor takes one image at a time
* [x] Check if it works on CPU
* [x] Put checkpoints in data directory
* [x] Find someplace to put the image data
* [x] Fix CI breakages
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1661
Reviewed By: drisspg
Differential Revision: D46089147
Pulled By: msaroufim
fbshipit-source-id: 00d094aea4a6a379fe389cce94449f0a387c68dc
