transformers
79988c35
- Merge remote-tracking branch 'upstream/main' into fsdp2-ep-2d-mesh
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
65 days ago
Merge remote-tracking branch 'upstream/main' into fsdp2-ep-2d-mesh # Conflicts: # src/transformers/distributed/configuration_utils.py # src/transformers/distributed/mixin.py # src/transformers/distributed/utils.py
References
#48516 - Enable FSDP2 + expert parallelism via a 2-D (fsdp, tp) device mesh
Author
qgallouedec
Parents
cb02b27f
5474a55e
Loading