[ROCm] Enable bfloat16 for ops in BERT model (#37634)
Summary:
Enables bfloat16 type for ops present in BERT model.
Enabled relevant unit tests.
ezyang jeffdaily
Pull Request resolved: https://github.com/pytorch/pytorch/pull/37634
Differential Revision: D21413957
Pulled By: ezyang
fbshipit-source-id: 19309fe46b4a2f07922bf5b32fee2066df514aeb
