[inductor] Fix "RuntimeError: Tried to erase Node permute but it still had 3 users in the graph" (#91327)
Summary: Fix "RuntimeError: Tried to erase Node permute but it still had 3 users in the graph" to unblock internal models
Differential Revision: D42213859
Pull Request resolved: https://github.com/pytorch/pytorch/pull/91327
Approved by: https://github.com/ngimel, https://github.com/anijain2305, https://github.com/jianyuh
