accelerate
Support sequential cpu offloading with torchao quantized tensors
#3085
Merged
Overview
Commits
2
Changes
View On GitHub

Support sequential cpu offloading with torchao quantized tensors #3085

SunMarc merged 2 commits into huggingface:main from a-r-r-o-w:torchao-diffusers-sequential-cpu-offload
a-r-r-o-w
a-r-r-o-w add support for AffineQuantizedTensor
89d012b5
a-r-r-o-w ruff
7e926710
HuggingFaceDocBuilderDev
sayakpaul sayakpaul requested a review from SunMarc SunMarc 1 year ago
sayakpaul sayakpaul requested a review from muellerzr muellerzr 1 year ago
SunMarc
SunMarc approved these changes on 2024-09-06
SunMarc SunMarc merged 5ad982ac into main 1 year ago
a-r-r-o-w a-r-r-o-w deleted the torchao-diffusers-sequential-cpu-offload branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum