Add TorchAOHfQuantizer #32306
SunMarc
merged
13 commits into
huggingface:main
from
jerryzh168:torchao
msaroufim
commented
on 2024-08-01
msaroufim
commented
on 2024-08-01
msaroufim
commented
on 2024-08-01
msaroufim
commented
on 2024-08-01
msaroufim
commented
on 2024-08-01
matthewdouglas
commented
on 2024-08-01
msaroufim
approved these changes
on 2024-08-02
Add TorchAOHfQuantizer
5782f380
SunMarc
commented
on 2024-08-07
Fix a few issues
9b6b688b
style
85ea6fed
Added tests and addressed some comments about dtype conversion
fe4edddc
fix torch_dtype warning message
e2d0478c
SunMarc
approved these changes
on 2024-08-08
fix tests
a2284df6
style
25f132b6
jerryzh168
commented
on 2024-08-08
TorchAOConfig -> TorchAoConfig
89ec2ce9
enable offload + fix memory with multi-gpu
91b4223e
jerryzh168
commented
on 2024-08-09
update torchao version requirement to 0.4.0
597d8ad6
sayakpaul
commented
on 2024-08-10
sayakpaul
commented
on 2024-08-10
better comments
3c893a81
Merge branch 'torchao' of github.com:jerryzh168/transformers into tor…
78313eb5
matthewdouglas
approved these changes
on 2024-08-12
add torch.compile to torchao README, add perf number link
130d2dfa
Reviewers
Assignees
No one assigned
Labels
Quantization
Milestone
No milestone
Login to write a write a comment.
Login via GitHub