The dispatch order for custom function (#60251)
Summary:
Hi, I am working on dev some custom ops.
And I found this issue:
Cause of the logical here: https://github.com/pytorch/pytorch/compare/master...zhuhaozhe:customer-op-trace?expand=1#diff-d7ade8589773904745c0cf965a19f24c940f1d36038f4c0ce85af2f3d89991dcL173-L177.
For all custom ops, "Tracer" dispatch key got the highest priority.
This make custom-ops and non-custom-ops get different behavior during dispatch. I do not understand whether there exist some special reason to let custom-ops "trace" first then begin to "dispatch".
Pull Request resolved: https://github.com/pytorch/pytorch/pull/60251
Reviewed By: malfet
Differential Revision: D29577131
Pulled By: ezyang
fbshipit-source-id: a8e824029cf934f09f29638b127961a6a5c332de