[Examples] use loralinear instead of depecrecated lora attn procs. #5331
use loralinear instead of depecrecated lora attn procs.
e3dcb5f6
fix parameters()
7d0e614b
fix saving
2656716d
add back support for add kv proj.
edd9e73d
fix: param accumul,ation.
5bd7fe2d
Merge branch 'main' into graduate-lora-training
af18c18c
propagate the changes.
6f94a7a9
sayakpaul
marked this pull request as ready for review 2 years ago
Merge branch 'main' into graduate-lora-training
e217005f
sayakpaul
merged
0fa32bd6
into main 2 years ago
sayakpaul
deleted the graduate-lora-training branch 2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub