benchmark
d24ff043 - Provide requirements that fix hf MPT 7b instuct (#2194)

Commit
2 years ago
Provide requirements that fix hf MPT 7b instuct (#2194) Summary: The model `hf MPT 7b instruct `was currently failing as it was missing the installation of `einops`. `ImportError: This modeling file requires the following packages that were not found in your environment: einops. Run `pip install einops`` This PR adds a requirements file and the function to install it. so that the model runs: `python3 benchmark/run.py hf_MPT_7b_instruct -d cpu -t eval --metrics model_flops,cpu_peak_mem,ttfb ` ``` Module FLOP % Total ----------- --------- --------- Global 6946.036B 100.00% - aten.mm 6808.597B 98.02% - aten.bmm 137.439B 1.98% CPU Wall Time per batch: 8572.018 milliseconds CPU Wall Time: 8572.018 milliseconds Time to first batch: 93223.4272 ms Model Flops: 0.8103 TFLOPs per second CPU Peak Memory: 26.3457 GB ``` Pull Request resolved: https://github.com/pytorch/benchmark/pull/2194 Reviewed By: aaronenyeshi Differential Revision: D54884951 Pulled By: xuzhao9 fbshipit-source-id: 58f2cde95f0d1487f986e9f79ebe2e3178731fbf
Author
Parents
Loading