peft
FEAT Add function to convert non-LoRA PEFT adapters to LoRA
#2939
Open
Overview
Commits
37
Changes
View On GitHub

FEAT Add function to convert non-LoRA PEFT adapters to LoRA #2939

BenjaminBossan wants to merge 37 commits into huggingface:main from BenjaminBossan:feat-lora-conversion
BenjaminBossan
BenjaminBossan [WIP] FEAT Add function to convert to LoRA
f91f54b7
HuggingFaceDocBuilderDev
BenjaminBossan BenjaminBossan changed the title [WIP] FEAT Add function to convert to LoRA [WIP] FEAT Add function to convert non-LoRA PEFT adapters to LoRA 16 days ago
BenjaminBossan Add tests for conversion
eb14cfba
BenjaminBossan More testing, docs, fix small issues
ab3f38c7
BenjaminBossan fix bug with other adapter name
9469f1f9
BenjaminBossan Support more PEFT types
64f5e8b5
BenjaminBossan Use hidden_states for comparison in tests
5614fb91
BenjaminBossan Fix for target_modules being str
9bb42eaf
BenjaminBossan Fixes for WaveFT, FourierFT, ShiRA
8e4fb0b6
BenjaminBossan Add common tests
f40887ed
BenjaminBossan Fix for Conv1D
a4aa2a55
BenjaminBossan Extend documentation
7846f97b
BenjaminBossan For testing conversion, ensure eval model
bed2a846
BenjaminBossan Merge branch 'main' into feat-lora-conversion
28c34767
BenjaminBossan BenjaminBossan requested a review from sayakpaul sayakpaul 15 days ago
BenjaminBossan Correctly deal with threshold = 1.0
32553205
BenjaminBossan Deal with rank=0
c374a513
BenjaminBossan Clean up docstrings, better wording, error message
ab3c492f
BenjaminBossan Simplify rank pattern logic a bit
f110cbc2
BenjaminBossan Deal with modules_to_save and bias
f9cd7aa3
sayakpaul
sayakpaul commented on 2025-12-10
sayakpaul
BenjaminBossan Reviewer feedback
d8945fc2
BenjaminBossan
BenjaminBossan commented on 2025-12-10
BenjaminBossan Add support for compilation
d05997a6
BenjaminBossan Simplify tests a little
24005265
BenjaminBossan Add stable diffusion test with Flux2
99b45213
BenjaminBossan Can't check for torch.compile on CPU
207b3317
BenjaminBossan Redo conversion experiment with more rigour
2762309b
BenjaminBossan Make style
2614894a
BenjaminBossan
BenjaminBossan commented on 2025-12-11
BenjaminBossan Fix table formatting
b8296ed6
sayakpaul
sayakpaul commented on 2025-12-11
sayakpaul
sayakpaul commented on 2025-12-11
BenjaminBossan Skip compile test if not Linux
86e7ce9e
BenjaminBossan Table in docs shows change in accuracy, memory
d6650c08
BenjaminBossan
BenjaminBossan commented on 2025-12-11
BenjaminBossan Fix issue with memory measure in conversion script
89647cb6
BenjaminBossan Fix return type in set_peft_model_state_dict
a041c57a
BenjaminBossan Allow compile without kwargs
46fcba4d
BenjaminBossan Fix issue with half precision weight dtypes
3e7ef47f
BenjaminBossan Update docs
05c60911
BenjaminBossan BenjaminBossan changed the title [WIP] FEAT Add function to convert non-LoRA PEFT adapters to LoRA FEAT Add function to convert non-LoRA PEFT adapters to LoRA 13 days ago
BenjaminBossan BenjaminBossan marked this pull request as ready for review 13 days ago
BenjaminBossan BenjaminBossan requested a review from githubnemo githubnemo 13 days ago
BenjaminBossan BenjaminBossan requested a review from sayakpaul sayakpaul 12 days ago
sayakpaul
sayakpaul approved these changes on 2025-12-12
BenjaminBossan Fix copyright notice
62d4bed6
BenjaminBossan
BenjaminBossan commented on 2025-12-17
BenjaminBossan
BenjaminBossan commented on 2025-12-17
BenjaminBossan
BenjaminBossan commented on 2025-12-17
githubnemo
githubnemo commented on 2025-12-17
BenjaminBossan Better document dynamic rank
be8b3029
BenjaminBossan Adjust table formatting, values are unchanged
9bb6c95b
BenjaminBossan Improve/fix comments
ce506bea
BenjaminBossan BenjaminBossan requested a review from githubnemo githubnemo 6 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum