Megatron-DeepSpeed

cd597c8f - Followup PR for adding generation-server (#339)

Followup PR for adding generation-server (#339) * fix grpc * use functools.partial * fix ds-inference server * add support for int8 * update README * fix bugs Co-authored-by: Mayank Mishra <mayank31398@gmail.com>