Fix PEFT x MoEs #43261
ArthurZucker
merged
67 commits into
main
from
peft-x-moes
current changes
fecb9614
finally!
97485bfd
collection is giid
070dc03c
what kinda works
2dd33fcd
nit
20849aeb
fix name
e4e14cef
small nits
016fef08
introduce loading info and config?
69edb491
try to remove some duplication
31884a04
trying to simplify its really not that hard is it?
ceb23843
nit
7ea396f0
is this better?
42ab9fd5
update
605801bb
Merge branch 'main' of github.com:huggingface/transformers into peft-…
851d3556
fix
6abfb771
better?
6497a5d3
small fix
f1ba880a
force change lora
a22bc4e9
push
176cc119
up
86ba8c33
replace gate_up_
df02ccf8
push
95e76243
Updated Ben (#43319)
50e4f0ef
Getting closer (#43327)
6857f5f2
Merge branch 'main' of github.com:huggingface/transformers into peft-…
86b74c5a
style
8b05cdb4
bring back eval()
bcee589f
nits
8bbadfbf
Revert "bring back eval()"
75b13537
fix quantizer
bffbc059
fix
a4056784
fix key mapping not recognized
14821fda
fix kwargs shinannigans
bbbb4485
fix more kwargs passing
86cbf26d
up
408a3feb
fix `use_safetensors=False` call?
76cd4ad1
nits?
46623ce9
properly pass use_safetensors=False
c62ba1d0
fix
a2aa0851
style
6d38d1df
defaut factory
7dff58dd
style
124449ea
simplify
d31390f1
fix custom adapter_state_dict
2b85ff98
small updates
4d6d7631
nit
821acc75
style
1326a2a3
Fix mixtral loading
5c97c862
Make style
36aa96ef
Fix error messages
fc7c1f80
hardcode checking if .bin works
9436a4bb
fix another test
19fe8341
Merge branch 'peft-x-moes' of github.com:huggingface/transformers int…
f6d9f4ed
fix regex renaming patterns
92d0fad6
nits
11c58cf0
Merge branch 'main' into peft-x-moes
d7290135
help debug tests
5c02c8a6
style
01245936
Merge branch 'peft-x-moes' of github.com:huggingface/transformers int…
4b7f2e1e
Patch `update_layer` instead of `_get_in_out_features`
654f49e3
Handle Qwen2 conversion similarly to mixtral
493948d4
updates, explicit, simplify
edb61fe5
style
7720711a
Merge branch 'peft-x-moes' of github.com:huggingface/transformers int…
94f2bc7e
nit
f33a1338
fix `httpx.LocalProtocolError: Illegal header value b'unknown/None; h…
5c92bbd5
some of the last nits
8c13e37c
ArthurZucker
commented
on 2026-01-24
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub