zero.Init() should pin params in GPU memory as requested (#2953)
* Persist params in zero.Init
* Disable debug prints
* Formatting
* Avoid offloading persisted params
* Simplify world_size=1
* Formatting
* Remove pdb
* Restructure
* Formating
* Formatting
* Apply persistence only if ds_config available
* Fix typo
* add util function for getting pydantic config default values
---------
Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>