pytorch
42a5f6ee - Create stub function for doing SDPA cpp and cuda dispatch (#90576)

Commit
2 years ago
Create stub function for doing SDPA cpp and cuda dispatch (#90576) ## Summary Torch.compile was previously not working for transformerencoder because torch.SDPA calls a native function on tensors that returns an int. This PR instead creates a dispatch stub for the function called in order to not create a separate fx node for this native function. As well this pr adds meta functions for the fused kerenels. Pull Request resolved: https://github.com/pytorch/pytorch/pull/90576 Approved by: https://github.com/cpuhrsch
Author
Committer
Parents
Loading