Merge branch 'main' into distributed_api - SemanticDiff

Commit

4 hours ago

Merge branch 'main' into distributed_api

References

distributed_api

#44083 - FSDP2 native support in transformers

#44974 - Refactor core_model_loading to support FSDP shard-on-read loading

#44989 - 🚨 Distributed training API

#44996 - from_pretrained distributed refactor (FSDP2 + TP)

Author

3outeille

3outeille

Parents

Loading