DeepSpeed

48d54e05 - [AutoTP] Enable HF `colwise_gather_output` to support `lm_head` replace (#8146)

[AutoTP] Enable HF `colwise_gather_output` to support `lm_head` replace (#8146) ### Changes Enable HF `colwise_gather_output` in `tp_plan` through AutoTP, allowing vocab parallelism for an untied `lm_head`. ### Known Limitations - Only supports an untied `lm_head`. Tied `lm_head` falls back to the legacy implementation. - Uneven tensor parallelism is not supported in this PR. --------- Signed-off-by: iLeGend <824040212@qq.com> Co-authored-by: Ma, Guokai <guokai.ma@gmail.com>