transformers
Cleaner Cache `dtype` and `device` extraction for CUDA graph generation for quantizers compatibility
#29079
Merged
Merged
Cleaner Cache `dtype` and `device` extraction for CUDA graph generation for quantizers compatibility #29079
younesbelkada
merged
6 commits into
huggingface:main
from
BlackSamorez:setup_cache_fix
input_layernorm as the beacon of hope
f93e7308
younesbelkada
commented
on 2024-02-19
cleaner dtype extraction
a956ec8a
Merge branch 'main' into setup_cache_fix
042c2d52
BlackSamorez
changed the title
younesbelkada
approved these changes
on 2024-02-22
AQLM + CUDA graph test
edebc721
is available check
39d7603d
younesbelkada
approved these changes
on 2024-02-23
shorter text test
1c0adb8e
ArthurZucker
approved these changes
on 2024-02-27
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub