DeepSpeed
a9328b9f
- kernels added for asym fine-grained block quantization with 8bits
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
kernels added for asym fine-grained block quantization with 8bits
References
#4450 - adding 8bit dequantization kernel for asym fine-grained block quantization in zero-inference
Author
styoun
Parents
0636c74c
Loading