accelerate
Set the state device dependant to Accelerator on multigpu
#1220
Merged
Overview
Commits
13
Changes
View On GitHub

Set the state device dependant to Accelerator on multigpu #1220

muellerzr merged 13 commits into main from loading-state
muellerzr
muellerzr Set the state device dependant to Accelerator on multigpu
ab39e4b8
muellerzr muellerzr added enhancement
muellerzr muellerzr requested a review from sgugger sgugger 2 years ago
muellerzr Use map location
e862ccd0
HuggingFaceDocBuilderDev
sgugger
sgugger commented on 2023-03-20
muellerzr Use on_device and PartialState
43990678
muellerzr Move import
480e9e30
muellerzr muellerzr requested a review from sgugger sgugger 2 years ago
sgugger
sgugger commented on 2023-03-20
muellerzr Check for multi-gpu
1e6f5122
muellerzr Change logic in accelerator as well
f0e40ff4
muellerzr Pop from load_model_func kwargs
a4b81e0b
muellerzr muellerzr requested a review from sgugger sgugger 2 years ago
muellerzr Working
86de8958
muellerzr Add tests
f92b48ca
muellerzr
muellerzr commented on 2023-04-06
sgugger
sgugger commented on 2023-04-06
muellerzr Working, needed to change model device
75466f60
sgugger
sgugger approved these changes on 2023-04-06
muellerzr move to main to be ran multicuda
662ad594
muellerzr Call test
24e95c9b
muellerzr Only CUDA
d021379f
muellerzr muellerzr merged b757b623 into main 2 years ago
muellerzr muellerzr deleted the loading-state branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
enhancement
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum