transformers
e3fc90ae
- Cleaner Cache `dtype` and `device` extraction for CUDA graph generation for quantizers compatibility (#29079)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Cleaner Cache `dtype` and `device` extraction for CUDA graph generation for quantizers compatibility (#29079) * input_layernorm as the beacon of hope * cleaner dtype extraction * AQLM + CUDA graph test * is available check * shorter text test
References
#29079 - Cleaner Cache `dtype` and `device` extraction for CUDA graph generation for quantizers compatibility
Author
BlackSamorez
Parents
a3f9221a
Loading