pytorch
ae4fbac8 - Enable nvprims.transpose fusions for nvFuser (#86967)

Comment changes are shownComment changes are hidden
Commit
2 years ago
Enable nvprims.transpose fusions for nvFuser (#86967) This PR allows transposes to be fused with other operations. If a fusion group is formed only from operations that just manipulate metadata in PyTorch (transpose, view, etc.) then this group is not sent to nvFuser. On top of that if we have converted to `nvprims` but then decided to not form a fusion group we modify the graph use `prim.impl_aten` attribute instead of calling `prim(*args, **kwargs)` that has a higher overhead. cc @kevinstephano @jjsjann123 Pull Request resolved: https://github.com/pytorch/pytorch/pull/86967 Approved by: https://github.com/jjsjann123, https://github.com/SherlockNoMad
Author
Committer
Parents
  • test
    • File
      test_prims.py
  • torch
    • _prims
      • File
        __init__.py
      • File
        context.py
      • File
        nvfuser_executor.py
      • File
        nvfuser_prims.py
    • fx/passes/infra
      • File
        partitioner.py