transformers
e3fc90ae - Cleaner Cache `dtype` and `device` extraction for CUDA graph generation for quantizers compatibility (#29079)

Commit
1 year ago
Cleaner Cache `dtype` and `device` extraction for CUDA graph generation for quantizers compatibility (#29079) * input_layernorm as the beacon of hope * cleaner dtype extraction * AQLM + CUDA graph test * is available check * shorter text test
Author
Parents
Loading