DeepSpeed

9d753116 - Enhance Gaudi2 CI/Nightly Coverage with Model Parallelism and Linear Tests (#7146)

Enhance Gaudi2 CI/Nightly Coverage with Model Parallelism and Linear Tests (#7146) Enhancing ci/nightly coverage for gaudi2 device Tests added : test_autotp_training.py test_ulysses.py test_linear::TestLoRALinear and test_linear::TestBasicLinear test_ctx::TestEngine these provide coverage for model_parallesim and linear feature. The tests are stable. 10/10 runs pass. New tests addition is expected to increase ci time by 3-4 mins and nightly job time by 15 min. Signed-off-by: Shaik Raza Sikander <srsikander@habana.ai> Signed-off-by: Logan Adams <loadams@microsoft.com>