accelerate
Reduce key merging overhead in OffloadedWeightsLoader
#4281
Merged

Reduce key merging overhead in OffloadedWeightsLoader #4281

emme1t
emme1t perf: make offloaded weight key merging linear
3c153aa7
SunMarc
SunMarc approved these changes on 2026-09-25
SunMarc Update tests/test_offload.py
b95b43ae
HuggingFaceDocBuilderDev
SunMarc SunMarc merged 65f83e49 into main 29 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone