peft
b67c9b64 - FIX: Bug in find_minimal_target_modules (#2083)

Commit
1 year ago
FIX: Bug in find_minimal_target_modules (#2083) This bug was reported by Sayak and would occur if a required suffix had itself as suffix a string that was already determined to be required, in which case this required suffix would not be added. The fix consists of prefixing a "." to the suffix before checking if it is required or not. On top of this, the algorithm has been changed to be deterministic. Previously, it was not deterministic because a dictionary that was looped over was built from a set, and sets don't guarantee order. This would result in the loop being in arbitrary order. As long as the algorithm is 100% correct, the order should not matter. But in case we find bugs like this, the order does matter. We don't want bugs to be flaky, therefore it is best to sort the dict and remove randomness from the function. --------- Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Parents
Loading