DeepSpeed
9fa4c424 - fix: quantization with DeepSpeed HE (#5624)

Commit
1 year ago
fix: quantization with DeepSpeed HE (#5624) When the model is quantized, the hidden sizes cannot be determined from `ds_shape` and `shape`, because they are 1 dimensional. This PR fixes the bug by determining hidden sizes from `in_features` and `out_features`. This PR fixes #5398 Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com> Co-authored-by: Lev Kurilenko <113481193+lekurile@users.noreply.github.com> Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
Author
Parents
Loading