Fix Unfuse Lora (#4833)

Commit

2 years ago

Fix Unfuse Lora (#4833) * Fix Unfuse Lora * add tests * Fix more * Fix more * Fix all * make style * make style