accelerate
Fix `align_module_device`, ensure only cpu tensors for `get_state_dict_offloaded_model`
#3217

Merged

Fix `align_module_device`, ensure only cpu tensors for `get_state_dict_offloaded_model` #3217

SunMarc merged 2 commits into huggingface:main from kylesayrs:kylesayrs/align-module-device-fix

only onload direct parameter descendants, move buffers to cpu, add tests

4ba6222f

remove no longer applicable comment

4133795a

kylesayrs marked this pull request as draft 1 year ago

kylesayrs marked this pull request as ready for review 1 year ago

muellerzr approved these changes on 2024-11-05

muellerzr requested a review from

SunMarc 1 year ago

SunMarc approved these changes on 2024-11-05

SunMarc merged c0552c90 into main 1 year ago

kylesayrs deleted the kylesayrs/align-module-device-fix branch 1 year ago

Reviewers

SunMarc

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone