accelerate
30631a65 - disk offloading do not reload tied parameters in memory

Commit

2 years ago

disk offloading do not reload tied parameters in memory

References

#2330 - Avoid duplicating memory for tied weights in `dispatch_model`, and in forward with offloading

Author

invalid-email-address

invalid-email-address

Parents

Loading