transformers
load_in_8bit now respects 'balanced' device maps in multi-gpu environments
#22377

Merged

load_in_8bit now respects 'balanced' device maps in multi-gpu environments #22377

sgugger merged 1 commit into huggingface:main from kooshi:balanced_memory_8bit

balanced 8bit memory

7c0dfec5

sgugger approved these changes on 2023-03-27

sgugger merged 66d1eee6 into main 3 years ago

kooshi deleted the balanced_memory_8bit branch 3 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone