[functorch] Single cache (pytorch/functorch#319)
* [CompileCache] Adding compilation cache
* [Single cache]
* Cleaning up
* Remove the templating for args
* Make things faster
* sped it up even more
* remove benchmarking coe
* make stupid fix
Co-authored-by: Horace He <horacehe2007@yahoo.com>