Refactor weight loading #41580
ArthurZucker
merged
387 commits into
main
from
refactor-weight-loading
ArthurZucker
commented
on 2025-10-14
ArthurZucker
commented
on 2025-10-14
ArthurZucker
commented
on 2025-10-14
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
commented
on 2025-10-30
LysandreJik
approved these changes
on 2025-10-30
ah actually we don't discard lm head if missing -> needs to be moved …
4d797099
fix some tests
d1e84db3
small fixes
f2938df8
up
22fcdaf9
up
7d78aa1b
dik why we tie weights twice but,..,,.
80517f53
ups
2ff85326
removeunused
d923061e
fix hunyuan
ce8c1c19
small fix
23e3ed74
nits
a8fb5540
ish
ab6ee8ae
up
77ccbb17
rev
8a8beff7
fix more tie weights keys
02386ce7
small fixes
1c87945a
nit
00b95ee0
update
a170f290
fix and fix
8b924a3b
fix a test
8f7b1d02
glubs
93862177
current shitty changes
4894a257
ship validated ones
da7dc100
more
d7c81717
more update
e0884089
more
4f212de4
more
dc5a22c2
more
675b2bca
mllama
f85f2397
more up
76b6a92d
fix ernie
ba1a8b64
fix xopies
ba3de5ad
up more
8fd255c7
more fixes
5d7507b1
up
0fb23403
up
32b92738
fix-copies
0b95826c
fix more
5794d27d
more updates
5e71bd4a
AI UPDATE
20d1b340
up
89846e7d
hoey
a581fd75
make it fast
1652c9c5
fix
dcad7030
lol
c921cede
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
50714d8c
fix asjusting
8936cc40
more fixes
5c54332e
_dtype nit
ff108789
up
9601b82c
nit
db02b9d7
update
42fd4c43
update
45271710
remove semaphores
bd362112
fix import to avoid jit execution
e2aefee7
try to remove custom tiing logic when its stupid
74a0e9c7
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
ead2ac37
fix more individual models
e7165da0
fix whisper as well
2ff765e9
fix?
912562c0
fox umt5
c43495a5
improve tqdm bar
57988f25
cleanup a bit
8c16de16
oupsi
b8927d67
some updates
2733ff69
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
8baa3fe9
improve
d91701f7
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
5146dec4
remove all buffering -> much faster without it
acc5b245
remove some tie_weights custome funcs when not needed
58389a1f
more fixes related to strict matching regex
92c0229a
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
d9e7fe65
remove ALL custom tie weights
b57d7897
BenjaminBossan
commented
on 2025-11-05
small update
ef8b6c35
revert change to init scheme (no need for params)
a228fd0a
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
07574ddd
mixtral init
2526cc5d
kylesayrs
commented
on 2025-11-05
kylesayrs
commented
on 2025-11-05
kylesayrs
commented
on 2025-11-05
try less strict source check
6cb37940
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
e4cadfb1
tied weight first shot to the fiiiixxxxxx
3fea8658
does this help?
82f94b8a
:)
84dd6eb2
fix some ppolry defined tied_weights_keys for now
cc081954
subclass nn.Parameters
f692f4bd
up
2fa058fe
lol
78d46227
Ouiiii
8ff4ad56
fix led
32226787
fix long cat flash
9a76a6ee
fix qwen and long cat flash
9fde9f78
properly fix qwen init
074a449f
just push this for now
dde5500d
propnet is dumb
0e7d2d05
update
18b02eea
push
9c0db728
remove explict sharing of some tied keys.
75d3afcb
update decoder.bias
85ab0859
moe case
443573ae
more changes to untangle old hardcoded ting
f8f09734
fixup
5c9d56cb
Merge branch 'main' into refactor-weight-loading
a0029f20
fix big faileurs
44943fb8
fix prophnet
76d66be5
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
d176b489
fix resize token embeddings
3ffc59ef
nits
2a00e493
fix xcodex
f7d0183d
asyncio?
bbf5b000
fix smart apply
04128324
fix data-2-vec
c137ea33
[build-ci-image]
7b7c9903
checkout
de74aebb
uupdate
94a53d4c
fix hunyuan
8755a4be
update error message
5be67b96
fix deformable detr
86a4e516
fixes
09bcd2ee
fix init weights for non param gate up projs
7b457fd0
shared todo?
e033947a
update some models
f93f3570
big revert, don't break this behaviour
2f0a6aed
ty @SunMarc this fixes the buffers
3c8c7572
mt5 fuck
f5a7c33d
fix lxmbert
647f720a
nuke slow test fetcher
bed6ea1c
fix zamba and deepcopy for now
2ec0a5fb
fix zamba tied weight keys! ~
f9c7ef87
fix-copies
8df3ffd8
update fetch terst
e76481b9
fix gradient for test modeling common!
de007511
break "shared" for now I will fix tomorrow changes are properly isoal…
cdd1a9b3
does this fix marian? probably not
d3f64762
fix some vlms
0a7db831
D fine seems to handle this well
18142005
glob is fine actually
b77825d3
fix dab detr
5dbb7833
small steps
9edc81b8
opusy
970f4e53
fix some more models?
0361d47d
yups
dc757737
better erro
cdb12846
fix?
de9a2d98
fix double escape
b9a9f4d8
escape wehere it makes sense
c944619e
??
f9105240
fix ibert
4aa2ade0
fix tvp as well
2ef1c2b2
more fxes
b98a7bce
try always download ref PR
74e6c871
ONONONO
5064edd1
big fixup
3f8a304c
more fixup
3ecaa63d
small step
f384524e
small nits
290337a2
nits
76b388c9
brut force some stuff
e69b988e
fix vilt
c2781f57
make sure special models that always need tie always tie
f64ee960
cleaning up
a3e40152
small nits
9eecbd27
fix zamba and bridge tower!
b2fa432b
just fixup
dbbfdf29
potential culprits
ab4890c8
revert bark and fix bridgetower
937ebf36
Merge branch 'main' of github.com:huggingface/transformers into refac…
e4f9697f
remove now non existant tie_weights
17803ce9
?
9f6838a2
lol reformer actually had nothing tied!
1afb3eb5
wow these two fucking models were really not well made
f01a149a
fix sam family!
0b369802
fix bark revision
d740c82b
fix speech2test ?
6f3940ee
push this for now....
b2f6f61a
upsy
ade8dab4
the fuck
f956ccfb
fix rtdetr
99c6fd49
update
1ffcfc3f
proper
ee62aec5
wow that one 's annoying
6ec80f86
update
b05e3290
try to find the culprit
2606596f
get some help on common
d9e8a09d
nit about general init and cls.padding_idx
581665ae
revert num workers update
c43bc687
remove old loading func
b6fe4158
fix glob
4bb8e5c9
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
7d52b063
add annotations
455bcc7c
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
fc884c03
fix re
2e0ed5d2
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
3ddd1cca
small improvements
1f86a104
fix conflict
4d56fbf1
clean some stuff
67a8eebb
improvements
e9168ff5
someone did not understannnnnnd what I tried to dooo or does BNB not …
feda22d9
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
70841c9f
gluos
52248ba3
fix case when `.` is just not there
e8dd4a45
remove unused arg
1c67fc49
recover orignal parameter/buffer using _original
e20ed001
fix glob issu
827c42a2
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
e5e4d28e
this?
4db2aa60
deepspeed best-effort
2b16c177
remove unused stuff
c411ddb2
Update tie weight keys as they were just wroong
56d368b1
up
85d0ac1e
Merge branch 'refactor-weight-loading' of github.com:huggingface/tran…
daa642c1
augustuc clauss, a gloubs gloups gloubs
bbf71b92
fixup
127e4d56
fixup
79541859
there was fucking typo
f7cd4b3f
mrain
f9e747e7
nits
57bf5b28
fix marian 3 remaining tests
c38ad244
one more
d7be7df6
fix some of the copies, not all :)
729e3df6
small cleanup
c95a3f16
one propertest
87788403
fix core model loadig tes
1181e3f7
attempt a new test
b750e6b9
fix some of the annoying tests by supporting reading .bin sometimes
3178c3f0
push
d6ab2505
push more small fixes
0695197d
Merge branch 'main' of github.com:huggingface/transformers into refac…
fd5a75a3
remove 1 useless test
f54b5286
up
1abf6a9b
fix audio flamingo post rebase
30142909
fixup
1f1bea3c
some small updatess
c2dbca0e
fix sam models
347b966a
nits
40ed6364
up
3b2f9342
updates
fb0fb895
onem ore
92e27714
skip this stupid test
06f2ba9a
some other fixes
3d5c86c7
fixup
15bc48e8
update
47743f86
skip more offloaded stuff
d77cf579
oups
75f2bd44
ups
08ad69b5
update mixtral
b605e1a3
skip this one
91d40b87
LET"SGO
638bbfca
fixup
7daacb43
rope delta order
22c19a72
fix csm
6d89354e
small nit
9ccb6935
fxmarty-amd
commented
on 2025-11-17
fxmarty-amd
commented
on 2025-11-17
Reviewers
Assignees
No one assigned
Labels
Core: Modeling
for_v5?
Milestone
No milestone
Login to write a write a comment.
Login via GitHub