pytorch

8d753c80 - [WIP] Upstream push 0627 (#80355)

[WIP] Upstream push 0627 (#80355) Syncing nvfuser devel branch to upstream master. https://github.com/csarofeen/pytorch/ Code changes includes: - TransformPropagator refactor: switched to Dijkstra instead of exhaustive enumeration on all possible paths to reduce compilation time on transform propagation; - Indexing refactor: remove reference tensor creation in all tensor indexing logic (#1690) - (more) generic grouped grid reduction kernel; - Minor parser/fuser patches: 1. zero-dim tensor reduction support 3. no-op binary removal within fused graph 4. expand supported in fusion Squashed commits to WAR github API Commits that's actually in this PR from the devel branch: ``` a054b3efcf5af58ea518de283f55aaf9fe06ff5f Refactor TransormPropagator to allow specifying a position and propagating to part of the DAG (#1775) d67e1cda9b802036841a371318014a818a849b0a Indexing refactor stage 1: remove reference tensor creation in all tensor indexing logic (#1690) 1b6529956a1ace220898ad09dde0bf85e49827f7 Issue 1770 (#1774) 35b04276b648c9b55cdb6a67f3889f54e745c3d2 Avoid compilation errors like below: (#1773) 452c77326a340d2a4130b7802f4f319aec60e72a Ignore reductions of zero-dim tensors per PyTorch conventions (#1771) 31d6c56d88afba09ac53b2d5dd3493d625f8cd57 TransformPropagator refactor (#1769) 570c5a84b91a3cf67207331be9650d26a2d37e3d Merge pull request #1767 from csarofeen/upstream_merge_0621 9d6c3d84be86da643df6fd51695543938111f20d merging upstream 61305cd638b6fcd73a0b66b4cde7014fecb9e8ce 0ed815f76b08f285bda855dd500692ff10a8abce New TransformPropagator algorithm (#1763) 6c195200c0a92fb0f38c833431a8940ed07569b9 no-op binary removal (#1764) ec7fa4187c177186527409dfc5c7b1754d30bc92 Proper propagation of IterType (#1762) b263562dbc3c865007ad7d7d42a58a20be8d7922 Fix dimensionality check (#1759) 2d6343f6cc1e47b63ef20a50d1446f6480736478 More generic grouped grid reduction kernel (#1740) 64e2b56df2c8b9fd22a362d9cc05974a8607ef3d [nvfuser] prevent spamming warning message (#77777) (#1758) 0c431624ff15b6458b9f9b674a3852373fc426b1 [nvFuser] Improving bitwise ops support (#77158) (#1757) b93a14777fde3b9b39684b9cf1715651a806b281 Parser expand (#1754) ``` RUN_TORCHBENCH: nvfuser Pull Request resolved: https://github.com/pytorch/pytorch/pull/80355 Approved by: https://github.com/davidberard98