Precomputing Transposes for frozen linear layers (#65631)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/65631
Test Plan: Imported from OSS
Reviewed By: eellison
Differential Revision: D31314248
Pulled By: Gamrix
fbshipit-source-id: 85611f3ccfe7b91a183d5d12f7fb9aca3c51acb0
