accelerate
806ac848 - [FSDP2] Issues in Wrap Policy and Mixed Precision (#3528)

Commit
285 days ago
[FSDP2] Issues in Wrap Policy and Mixed Precision (#3528) * fix fsdp2 wrap policy * nn.Module doesn't have the dtype attribute * Revert "nn.Module doesn't have the dtype attribute" This reverts commit 513c7892876f81ec76ce32bcdce83bfe8556491d. * Fix dtype handling in fsdp2_prepare_model to accommodate nn.Module without dtype attribute * fix format problem
Author
Parents
Loading