Merge branch 'main' into fsdp2-ep-2d-mesh - SemanticDiff

Commit

22 days ago

Merge branch 'main' into fsdp2-ep-2d-mesh

References

#48204 - [Umbrella] FSDP2 + expert-parallel token dispatch, with sharded-loading prefetch

#48516 - Enable FSDP2 + expert parallelism via a 2-D (fsdp, tp) device mesh

#48792 - Add Expert parallel

Author

qgallouedec

qgallouedec

Parents

Loading