accelerate
65f83e49
- Reduce key merging overhead in OffloadedWeightsLoader (#4281)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
22 days ago
Reduce key merging overhead in OffloadedWeightsLoader (#4281) * perf: make offloaded weight key merging linear * Update tests/test_offload.py --------- Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
References
#4281 - Reduce key merging overhead in OffloadedWeightsLoader
Author
emme1t
Parents
05bf97ef
Loading