transformers
Fix the initialization of the cache when we have multi gpu
#33303
Merged
Merged
Fix the initialization of the cache when we have multi gpu #33303
SunMarc
merged
12 commits into
main
from
init-multi-gpu-cache
init cache multi-gpu
2381f30e
Update src/transformers/generation/utils.py
080bc81d
switch to execution device map
011bf498
naming more consistant
4bcefd5c
fix
ef89cf69
mutually exclusive device
8cdff4f7
added an integration example
fdccf828
remove useless check
1c087066
dvrogozh
approved these changes
on 2024-09-05
suggestion from joao + typing
74af9c68
fix couple of typo and add test
6bb5daa3
gante
approved these changes
on 2024-09-06
guangy10
approved these changes
on 2024-09-09
ArthurZucker
commented
on 2024-09-12
revert check
61f5baae
Merge remote-tracking branch 'upstream/main' into init-multi-gpu-cache
b426e7bf
ArthurZucker
approved these changes
on 2024-09-13
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub