[TinyLoRA]tinylora implementation #3024
kashif
wants to merge
29 commits into
huggingface:main
from
kashif:tinylora
initial tinylora
e85e43c1
support Embedding
79ee3c9e
add tests
13e6527b
proper init
76255cac
use _init_tinylora_v
23044c62
fix links and reference
03d841d1
sample for torch.normal
09e164c9
update docstring
5e03f26d
formatting
58c4f5ff
fix abstract
913b5fca
Merge branch 'main' into tinylora
473f316b
fix merge
282e9691
Update src/peft/tuners/tinylora/layer.py
f12dbad5
Update tests/test_decoder_models.py
ef698c14
Update tests/test_seq_classifier.py
8151ac61
Update tests/test_feature_extraction_models.py
b0990bb0
Update tests/test_encoder_decoder_models.py
9b1216a6
Update src/peft/peft_model.py
b8b7f965
address comments
19b626b3
define u as size of vector
50d29827
use nested ModuleDict/ParameterDict
8c2c55ab
use weight_tying float
36ab7887
update
d69ba7e0
r stays position, everything else from config
8b9c2d93
fix formatting
8d4fe220
kashif
changed the title
fix test
200f798f
added to methon_comparison
c52c26ad
Merge branch 'main' into tinylora
831b1e89
Merge branch 'main' into tinylora
b0dbbb45
Login to write a write a comment.
Login via GitHub