fixing multiple LoRA in the same batch or vit #1990
BenjaminBossan
merged
10 commits into
huggingface:main
from
saeid93:fixing-multi-lora-vit
fixing multiple LoRA in the same batch or vit
2579b85c
BenjaminBossan
commented
on 2024-08-06
removed patching by inheritance and used pytorch pre_hook instead
fd0a9ce2
added the test, mixed batch and forward arg functions
6b0290f1
changed the lora test layer
d143b131
added handling specific layers in mixed batch forward
a46ad627
updated documentation with modules_to_save information and caveats
d3bce93e
added tests for module_to_save with ModelEmbConv1D and tests for type…
60384bd3
clarification on docs and comments applied
683da8ba
removed extra import
e0a12b3c
added annotation backward compatibility
bed1a104
BenjaminBossan
approved these changes
on 2024-09-17
Login to write a write a comment.
Login via GitHub