FEAT Show adapter layer and model status (#1663)
This PR adds a new feature to PEFT models that allows to better
understand the status of adapter(s) on the model. Quoting from the doc
entry that I added:
Sometimes, the PEFT model can end up in a bad state, especially when
handling multiple adapters. There can be some confusion around what
adapters exist, which one is active, which one is merged, etc. To help
investigate this issue, you can call the
get_layer_status and the
get_model_status methods. The first one gives you a
detailed overview about the adapters for each targeted layer. The latter
one gives you a high-level overview about the model status.
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
