peft
8f397086 - ENH: Better DoRA check in mixed adapter batch inference (#2089)

Commit
1 year ago
ENH: Better DoRA check in mixed adapter batch inference (#2089) This is a bit of an edge case, but I noticed this while working on something else. PEFT allows mixed batch adapter inference, i.e. when predicting, the same batch can use different adapters by passing the adapter_names argument. However, this is not supported for DoRA (yet), so there is a check that raises an error if DoRA is used. Previously, this check would check all adapters for DoRA, even if those adapters are not being used in adapter_names. This was unnecessarily strict and with this PR, we only check the adapters that are actually being used.
Parents
Loading