transformers
24ab0dcc - [distributed] Wire resolve_parallel_plan into apply_tensor_parallel

Commit
106 days ago
[distributed] Wire resolve_parallel_plan into apply_tensor_parallel Replace exclusive SP|EP|TP plan selection with merged plans when tp_plan is unset. Add distributed test for TP+EP merged expert sharding.
Author
Committer
Parents
Loading