[export] Remove CallSpec (#117671)
Summary: This is not really being used anywhere
Test Plan: CI
Differential Revision: D52842563
Pull Request resolved: https://github.com/pytorch/pytorch/pull/117671
Approved by: https://github.com/avikchaudhuri, https://github.com/zhxchen17
