Memory planner and pattern generation enhancements. (#4443)
* static allocation.
* chanegs.
* contigious dynamic allocation.
* contigious dynamic allocation.
* fix bugs.
* fix bug.
* build errors.
* PR feedback.
* PR feedback.
* Update Graph builder for nccl_allreduce, mps.
* misc.
* fix windows build break.
* changes.
* fine-grained memory-time scheduling.
* merge.
* fix misc stuff.
* fix windows build.
* fix windows build.
* fix merge bug.
* merge conflicts.
* revert onnx-tensorrt submodule commit.
* fix submodule commit.
* misc.
* merge conflicts.
* Revert "merge conflicts."
This reverts commit 319a071a6e63e79d001afe40faba5adccd137902.
* merge conflict.
* merge conflict.
* merge conflicts.
* fixes.
* PR feedback.
* build break.
* build break.
* Add asserts.
* Add asserts.
* asserts.
* asserts.
* asserts.
* asserts.
* asserts.
* fixes.
* fixes.
Co-authored-by: Ubuntu <OrtTrainingDev3@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
Co-authored-by: root <root@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
