Skip PEFT LoRA Scaling if the scale is 1.0 #7576
sayakpaul
merged
12 commits into
huggingface:main
from
stevenjlm:skip-lora-scale-if-not-necessary
Skip scaling if scale is identity
52e606d6
Merge branch 'main' into skip-lora-scale-if-not-necessary
2a38d13b
move check for weight one to scale and unscale lora
800c7193
Merge branch 'skip-lora-scale-if-not-necessary' of https://github.com…
b96f421b
BenjaminBossan
approved these changes
on 2024-04-05
fix code style/quality
bba7838b
sayakpaul
commented
on 2024-04-05
sayakpaul
requested changes
on 2024-04-05
Merge branch 'main' into skip-lora-scale-if-not-necessary
b19838fb
sayakpaul
approved these changes
on 2024-04-06
Empty-Commit
067eb8ee
Merge branch 'skip-lora-scale-if-not-necessary' of https://github.com…
bfdac249
Merge branch 'main' into skip-lora-scale-if-not-necessary
d573f2ac
Merge branch 'main' into skip-lora-scale-if-not-necessary
daf95573
Merge branch 'skip-lora-scale-if-not-necessary' of https://github.com…
10415829
Merge branch 'main' into skip-lora-scale-if-not-necessary
ae2910a4
Login to write a write a comment.
Login via GitHub