pytorch
eadd84d0 - [ROCm] Enable FSDP BF16 comm hooks unit tests (#97517)

Commit
3 years ago
[ROCm] Enable FSDP BF16 comm hooks unit tests (#97517) This PR enables the following unit tests in FSDP feature on ROCm. ``` test_bf16_hook_has_wrapping_False_sharding_strategy_ShardingStrategy_FULL_SHARD test_bf16_hook_has_wrapping_False_sharding_strategy_ShardingStrategy_NO_SHARD test_bf16_hook_has_wrapping_False_sharding_strategy_ShardingStrategy_SHARD_GRAD_OP test_bf16_hook_has_wrapping_True_sharding_strategy_ShardingStrategy_FULL_SHARD test_bf16_hook_has_wrapping_True_sharding_strategy_ShardingStrategy_NO_SHARD test_bf16_hook_has_wrapping_True_sharding_strategy_ShardingStrategy_SHARD_GRAD_OP ``` Pull Request resolved: https://github.com/pytorch/pytorch/pull/97517 Approved by: https://github.com/pruthvistony, https://github.com/jeffdaily, https://github.com/jithunnair-amd, https://github.com/malfet
Author
Committer
Parents
Loading