DeepSpeed

15f94ae7 - Engine side fix for loading llama checkpoint fine-tuned with zero3 (#3981)

Engine side fix for loading llama checkpoint fine-tuned with zero3 (#3981) * Engine side fix for loading llama checkpoint fine-tuned with zero3 * Fixes to support llama fine-tuning in ds-chat * Refactored the code to avoid using an except block. * formatting * revert permissions change --------- Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>