transformers
Enable FSDP2 + expert parallelism via a 2-D (fsdp, tp) device mesh
#48516
Merged

Loading