peft
Add cartridges to PEFT
#2953
Open

Add cartridges to PEFT #2953

kashif wants to merge 20 commits into huggingface:main from kashif:Cartridges
kashif
kashif initial cartidges
1060f767
HuggingFaceDocBuilderDev
kashif add link to blog
43e9aebb
kashif fix test
549ecc0f
kashif further examples
03f8d430
kashif add CartridgeConfig
d6705aec
BenjaminBossan
BenjaminBossan requested changes on 2025-12-15
BenjaminBossan
BenjaminBossan commented on 2025-12-15
kashif fixes from review
48922f58
kashif
kashif model/task families that don’t support prefix KV-cache injection
a6102539
kashif fix example
086a6b8f
BenjaminBossan
BenjaminBossan requested changes on 2025-12-16
kashif Update examples/cartridge_self_study/README.md
3b2b77c1
kashif Update src/peft/tuners/cartridge/utils.py
3cf7c97a
kashif fix from reviews
36889133
kashif copyright
2d4e46aa
BenjaminBossan BenjaminBossan changed the title Add cartidges to PEFT Add cartridges to PEFT 11 days ago
kashif use vllm to synthsis data
69d7634d
kashif use device_map and correct dtype
5c563a6b
kashif teacher is just the student base model without peft
75e975b0
kashif use single model always
65138b95
kashif use the whole document as context for synthesis
b91a9fc3
BenjaminBossan BenjaminBossan requested a review from BenjaminBossan BenjaminBossan 4 days ago
kashif disable thinking
b5d92d0d
kashif Account for num_virtual_tokens in RoPE for PREFIX_TUNING/CARTRIDGE
4fb96da7
kashif position handling by offsetting position_ids and test
c2b58a62

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone