Add cartridges to PEFT #2953
initial cartidges
1060f767
add link to blog
43e9aebb
fix test
549ecc0f
further examples
03f8d430
add CartridgeConfig
d6705aec
fixes from review
48922f58
model/task families that don’t support prefix KV-cache injection
a6102539
fix example
086a6b8f
Update examples/cartridge_self_study/README.md
3b2b77c1
Update src/peft/tuners/cartridge/utils.py
3cf7c97a
fix from reviews
36889133
copyright
2d4e46aa
BenjaminBossan
changed the title Add cartidges to PEFT Add cartridges to PEFT 11 days ago
use vllm to synthsis data
69d7634d
use device_map and correct dtype
5c563a6b
teacher is just the student base model without peft
75e975b0
use single model always
65138b95
use the whole document as context for synthesis
b91a9fc3
disable thinking
b5d92d0d
Account for num_virtual_tokens in RoPE for PREFIX_TUNING/CARTRIDGE
4fb96da7
position handling by offsetting position_ids and test
c2b58a62
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub