Enable CPU test on speech_transformer (for accuracy test) (#791)
Summary:
This PR enables CPU train/eval test on speech_transformer (for accuracy test).
Pull Request resolved: https://github.com/pytorch/benchmark/pull/791
Reviewed By: anijain2305
Differential Revision: D34836544
Pulled By: xuzhao9
fbshipit-source-id: 1e53fe02b118f9bfa81cff74fce7d5add94cc197