accelerate
feature: CpuOffload pre_forward don't attempt to move if already on device
#3695
Merged
Overview
Commits
3
Changes
View On GitHub

feature: CpuOffload pre_forward don't attempt to move if already on device #3695

SunMarc merged 3 commits into huggingface:main from JoeGaffney:cpu-offload-optimizations
JoeGaffney
JoeGaffney feature: added optimisation to not attempt to move devices if allread…
4d0e8379
JoeGaffney fix: linting
a210d684
JoeGaffney JoeGaffney marked this pull request as ready for review 249 days ago
sam-noumena
sam-noumena approved these changes on 2025-07-26
S1ro1
SunMarc
SunMarc approved these changes on 2025-08-06
HuggingFaceDocBuilderDev
SunMarc
github-actions
github-actions[bot] Apply style fixes
d49f9df6
SunMarc SunMarc merged c0a3aefe into main 238 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum