[Static Runtime] prim::fork asyunchronous execution on JIT interpreter (#78858)
Summary:
prim::fork was executed synchronously in the main thread
- Added changes that executes the prim::fork calls on asynchronously on one of the threads from TaskThreadPoolBase defined in aten
- Changes are tested via pytorch profiler tracing. Fork calls are executed on different threads
Test Plan:
local tests scripts exected:
- buck run mode/opt caffe2/test:static_runtime
- buck run caffe2/benchmarks/static_runtime/fb:test_fb_operators
- buck run caffe2/benchmarks/static_runtime:static_runtime_cpptest
Executing pytorch profiler to see the spawned execution of fork operations in parallel on different threads
Differential Revision: D36909308
Pull Request resolved: https://github.com/pytorch/pytorch/pull/78858
Approved by: https://github.com/mikeiovine
