DeepSpeed
449e454f - mv DeepSpeedEngine param_names dict init post _configure_distributed_model (#4803)

Commit
2 years ago
mv DeepSpeedEngine param_names dict init post _configure_distributed_model (#4803) In some backends, when params are being moved from host to device, they might changed their python object id(), which uses a the key in the param_names dictionary. in such case this dict might become invalid. Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
Author
Parents
Loading