accelerate
reserve 10% GPU in `get_balanced_memory` to avoid OOM
#1798
Merged
Overview
Commits
4
Changes
View On GitHub

reserve 10% GPU in `get_balanced_memory` to avoid OOM #1798

sgugger merged 4 commits into huggingface:main from ranchlai:fix_auto_device_map_oom
ranchlai
ranchlai reserve 10% GPU to avoid OOM
8beca410
HuggingFaceDocBuilderDev
sgugger
sgugger commented on 2023-07-31
ranchlai update warning message
2e39b014
ranchlai use logger.info
de29eead
ranchlai clean up comment
0ede6768
ranchlai
sgugger
sgugger approved these changes on 2023-07-31
sgugger sgugger merged a24189db into main 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum