transformers
[loading] Really initialize on meta device for huge perf gains
#42941
Merged
Overview
Commits
24
Changes
View On GitHub

[loading] Really initialize on meta device for huge perf gains #42941

Cyrilvallez merged 24 commits into main from init-meta
Cyrilvallez
HuggingFaceDocBuilderDev
Cyrilvallez use meta device directly
c35e7dac
Cyrilvallez style
a0d280be
Cyrilvallez move back non-persistent
0043970b
Cyrilvallez fix
ffef6b9d
Cyrilvallez make helper
9ba18cb6
Cyrilvallez fix it
cf9feb87
Cyrilvallez use native param dtype
587512fd
Cyrilvallez make tensors buffers
d387bd35
Cyrilvallez Cyrilvallez force pushed from 2e4d93e8 to d387bd35 10 days ago
Cyrilvallez style
3766bdb9
Cyrilvallez fix
8d362cd7
Cyrilvallez oupsi
71cbe6a0
Cyrilvallez add a test and fix
567840ad
Cyrilvallez fix
0482f7ed
Cyrilvallez create timm integration to reinit non-persistemnt buffers....
e93debb7
Cyrilvallez style
56a4e2d3
Cyrilvallez style
76554d45
Cyrilvallez more
be9ad47f
Cyrilvallez better
15b18b8b
Cyrilvallez add doc
06f8f199
Cyrilvallez more timm stuff
09db4243
Cyrilvallez more
3d49151b
Cyrilvallez Cyrilvallez changed the title Init meta [loading] Really initialize on meta device for huge perf gains 9 days ago
Cyrilvallez fix
bf46f974
Cyrilvallez
Cyrilvallez commented on 2025-12-19
ArthurZucker
ArthurZucker approved these changes on 2025-12-19
Cyrilvallez small change
23a348de
github-actions
Cyrilvallez no actually it was fine before
48a12418
Cyrilvallez Cyrilvallez merged bb9357ff into main 9 days ago
Cyrilvallez Cyrilvallez deleted the init-meta branch 9 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum