Revert D28011862: Add pybind interface to caffe2 quantization server
Test Plan: revert-hammer
Differential Revision:
D28011862 (https://github.com/pytorch/pytorch/commit/81ef82e5f45ec57d90ad783d7808462c35d3d95b)
Original commit changeset: 647383017c4f
fbshipit-source-id: 1e2dbaba7c5fdc98d75a3bcf3722b529e9109348
