DeepSpeed
503706ac - Remove GatheredParameters context from replace_with_policy (#2591)

Commit
3 years ago
Remove GatheredParameters context from replace_with_policy (#2591) This PR removes the zero-infernece GatheredParameters context from replace_with_policy due to no longer needing zero-inference after the introduction of meta tensor support for BLOOM.
Author
Parents
Loading