pytorch
5fb68718 - Enable sdp_forward for NestedTensors (#86720)

Commit
3 years ago
Enable sdp_forward for NestedTensors (#86720) # Summary This PR implements a sdp_forward for NestedTensors. This impl will call into flash and mem_efficient_attention when possible. Pull Request resolved: https://github.com/pytorch/pytorch/pull/86720 Approved by: https://github.com/cpuhrsch
Author
Committer
Parents
Loading