transformers
Shard the parameters kept in float32 in their own FSDP2 group
#49501
Merged
Merged