[paramcomms] support for in and out split sizes (#57709)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/57709
NOTE: initial commit got reverted D28247764
Adding way to accept in and out split sizes.
Test Plan:
{F613245151}
https://www.internalfb.com/intern/perfdoctor/trace_view?filepath=tree%2Ftraces%2Fdynocli%2F0%2F1620153506%2F127.0.0.1%2Flibkineto_activities_1112677.json.gz&bucket=gpu_traces
NOTE: ignore the GPU user showing up in CPU - the issue is fixed in the diff above the stack D28196723 (https://github.com/pytorch/pytorch/commit/fc657b547aefb4ab5e83f0bf2da946e7c3dd98c2)
UPDATED: now the sizes are encoded as arrays in .json
https://www.internalfb.com/intern/perfdoctor/trace_view?filepath=tree%2Ftraces%2Fdynocli%2F0%2F1620259313%2F127.0.0.1%2Flibkineto_activities_3944235.json.gz&bucket=gpu_traces
Reviewed By: kingchc
Differential Revision: D28248333
fbshipit-source-id: cee523612667cb37170c94e3c40dab5fba432225
