text-generation-inference

c6e8b944 - fix(server): fix quantization for sharded models (#45)