Update form pretrained to make TP a first class citizen #36335
ArthurZucker
merged
79 commits into
main
from
safe-tensors
clean code
4fdb6a47
Merge branch 'main' of github.com:huggingface/transformers into safe-…
fe79aef9
oups
7f0ca674
fix merge
db4f78bc
yups
95753329
fix if
7346376b
now you can play
3fe75a0a
fix shape issue
034beab0
try non blocking
7be41570
fix
82a471fc
updates
fbf2912d
up
60824df6
updates
4981ffc3
fix most of thetests
1be42fc8
update
995f2250
update
85714010
small updates
b1ee64c4
up
a78842a7
fix the remaining bug?
d92b4e34
update
d573acbc
Merge branch 'main' into safe-tensors
740b52bb
rename when you read from the file
25bb5694
Merge branch 'safe-tensors' of github.com:huggingface/transformers in…
efb11165
buffer issues
d8aa45fc
current status
6a352480
cleanup
8e3a6aeb
properly allocate dumb memory
dfc864f9
update a small bug
a08c849b
fix colwise rep issue
2c7ab616
fix keep in float 32 that was keeping everything in float 32
7efe2192
typo
179e26b5
more fixes with keep_in_fp32_modules as we use to serach on it
046d6a11
ArthurZucker
changed the title
fix ROPE dtype for TP
52eda207
remove what's breaking the tests
ae79fad4
updates
acb45d69
update and fixes
93555c05
Merge branch 'main' into safe-tensors
c14ecccc
Merge branch 'main' of github.com:huggingface/transformers into safe-…
71fe6725
Merge branch 'safe-tensors' of github.com:huggingface/transformers in…
c3c6d85a
small cleanup after merging
f140cc82
allocate 2x to be safe
1fdd5225
style, auto
11b11077
update
d5c60231
yup nit
0b3a18b7
fix
d224cf88
remove slow as fuck torch api :(
f6893c90
work
18988233
fixup
4c2087f5
update
3e2526ef
brting the fix back
42c6119e
fix and update
45225051
fixes
6b9f2435
updates because some suggestions were wrong :eyes:
752bc950
update?
a5b84ec3
fuck this bloated function
b53d381c
typo
0c4e1731
fix the dumb prefix thing once and forall
4e8a8d57
fixes here and there
a9adbeb5
updates
feaf7f14
remove prints
a0b7af41
Merge branch 'main' of github.com:huggingface/transformers into safe-…
4e03eb9e
fix strict cases
0af4c229
styel
366aa1ff
properly fix keys on load!
634016ae
update
95fd0018
fix base model prefix issue
640dc389
style
e6bbf628
update
13522e9c
fix all?
d85e53f1
remoce 1 print
750c04cb
fix the final etsts
31b90df5
fixup
796cfb73
last nits
0e2eca8e
fix the detach issue which cause a 2x slowdown
7cab57ed
fixup
3c3a51e4
small fixes
050425c0
ultra nit
28245306
fix
62ed1be6
fix
c049e790
Login to write a write a comment.
Login via GitHub