Fix LoRA Fuse/Unfuse in Hybrid Engine (#3563)
* fix lora fuse unfuse in hybrid_engine
* fix name
* fix typo
* remove empty lines
* Update gptj.py
* add lora test-case + fix gptneo implementation
* try to fix format
* try to accelerate testcase by reducing max length
* reduce test runtime
* Fix bloom / gpt-neox and add test for bloom
* fix CI + fix issue in engine
---------
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Ammar Ahmad Awan <ammar.awan@microsoft.com>
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
