DeepSpeed
76679884 - Fix Hybrid Engine for BLOOM (#3580)

Commit
2 years ago
Fix Hybrid Engine for BLOOM (#3580) This PR fixes Hybrid Engine (HE) support for the BLOOM model, which was accidentally broken during the HE refactor in GH-3425. The BLOOM container now inherits the HybridEngineContainer feature and defines a set_lora_params() function necessary for the feature to work. get_lora_params() is correspondingly removed from the BLOOM policy class as well. GPT-NeoX was also cleaned up by removing a get_lora_params() function from its policy due to it no longer being used.
Author
Parents
Loading