text-generation-inference

8a4df6e1 - Only n_heads / process_group.size() are necessary.