[Lily] implementations for peft integration #3036
add impl for lily
8c8cac98
Merge branch 'main' of https://github.com/yibozhong/peft
30072d5b
update method path
4af346b2
update lily
1abe8ef8
Merge branch 'huggingface:main' into main
a58d3e58
Merge branch 'huggingface:main' into main
f14baa7b
fix inject adapter
4564d883
add lily __init__ path
021a3eaa
remove conv2d
a405f7ed
add constant
703d9304
fix inject adapter param
a124d091
fix lily layer forward pass
6053745a
fix lily layer forward pass
ebbb9a4a
fix lily layer forward pass
234602b1
scaling as float num type
43770db1
Merge remote-tracking branch 'upstream/main'
35676d61
Merge branch 'huggingface:main' into main
52751550
update year info
c9fbc3da
config doc for lily
bd94b90e
update scaling param name
9e6501c4
update lily layer related changes
648fda7f
update model implementation, no explicit override
5bec037e
misc
e3196e5c
update impl for lily for testing
7afca844
update layer type
3aaf6abb
remove all loggings
ec3f7cb3
merge upstream/main
6f261da4
misc
4e9eb5ad
update impl with cleaner code
aa90ea1f
update basetuner for _post_injection_hook api
fda86727
update test to skip merge-related tests
1b8aa267
add lily init test
31c8f5c8
Merge branch 'huggingface:main' into main
c400b91b
ruff
ca6cbb31
Merge branch 'huggingface:main' into main
655105c9
update style
601730ca
Merge branch 'huggingface:main' into main
a0193a5d
update doc
108d0a6b
update for better test_init for lily
388d682c
config test
f0869ca1
encoder decoder model test
271f7f9f
feature extraction model test
a9c6dd92
seq classifier model test
f087b3b6
Merge branch 'huggingface:main' into main
bd677fe5
add lily examples
226be76a
add metamathqa settings for lily
84ada441
remove unsued experiment settings
902e0391
merge
caf44744
Merge branch 'huggingface:main' into main
684962d3
update doc for lily
204cb31c
update doc and check style
a74e7c17
Merge branch 'huggingface:main' into main
d62c321f
style
196e350c
style
cd92abc3
undo improper changes
87bfeebc
add back mapping
94832139
remove einops dependency
630cccba
use larger lr for lily to reduce flakiness
489a14be
format
db9e072f
remove print
6a2ab8e9
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub