DeepSpeed

4d27225f - zero.Init() should pin params in GPU memory as requested (#2953)

zero.Init() should pin params in GPU memory as requested (#2953) * Persist params in zero.Init * Disable debug prints * Formatting * Avoid offloading persisted params * Simplify world_size=1 * Formatting * Remove pdb * Restructure * Formating * Formatting * Apply persistence only if ds_config available * Fix typo * add util function for getting pydantic config default values --------- Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>