accelerate
c0552c90
- Fix `align_module_device`, ensure only cpu tensors for `get_state_dict_offloaded_model` (#3217)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Fix `align_module_device`, ensure only cpu tensors for `get_state_dict_offloaded_model` (#3217) * only onload direct parameter descendants, move buffers to cpu, add tests * remove no longer applicable comment
References
#3217 - Fix `align_module_device`, ensure only cpu tensors for `get_state_dict_offloaded_model`
Author
kylesayrs
Parents
bf4572b6
Loading