Add functional overloads for activation, batchnorm, distance, embedding (#29358)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/29358
This PR adds functional overloads that take the full set of arguments (instead of just Options) for the following functionals:
- activation
- batchnorm
- distance
- embedding
These new functionals lives in the `torch::nn::functional::detail` namespace and they are only meant to be called from the module forward methods (i.e. they are not public API). This is in preparation for the future change where we make module Options and functional Options two different classes, because if the module forward method has to construct a new functional Options object every time it runs it will be pretty silly and bad performance.
Test Plan: Imported from OSS
Differential Revision: D18376976
Pulled By: yf225
fbshipit-source-id: 0b254dc6340b6d6ac08c9f95d2b1c02b791b2f38
