[Debuggability] Add feature to ORTTrainer Frontend (#5124)
* add option, feature to orttrainer and test
* address comments
* minor fixes
* further address comments
* minor changes
Co-authored-by: Rayan Krishnan <t-rakr@OrtDevTest2v100.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
