Enable typechecks for torch.nn.modules.[activation|upsampling] (#44093)
Summary:
Add missing `hardsigmoid`, `silu`, `hardswish` and `multi_head_attention_forward` to functional.pyi.in
Embed some typing annotations into functional.py
Pull Request resolved: https://github.com/pytorch/pytorch/pull/44093
Reviewed By: ezyang
Differential Revision: D23494384
Pulled By: malfet
fbshipit-source-id: 27023c16ff5951ceaebb78799c4629efa25f7c5c