resue device_mesh - SemanticDiff

Commit

10 days ago

resue device_mesh

References

#44083 - FSDP2 native support in transformers

#44974 - Refactor core_model_loading to support FSDP shard-on-read loading

#45028 - TP refactor for FSDP + TP integration

Author

3outeille

3outeille

Parents

Loading