DeepSpeed
improving int4 asymmetric quantization accuracy
#3190
Merged

improving int4 asymmetric quantization accuracy #3190

mrwyattii merged 13 commits into master from cholmes/int4-quant-accuracy
HeyangQin
cmikeh2 Fixes for asymmetric quantization
e39e97e1
HeyangQin addtional offset to further improve accuracy
30fa11d9
HeyangQin put the 0.5 into offset rather than applying it later
8886a18e
HeyangQin HeyangQin requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
HeyangQin HeyangQin requested a review from awan-10 awan-10 2 years ago
HeyangQin HeyangQin requested a review from jeffra jeffra 2 years ago
HeyangQin HeyangQin requested a review from cmikeh2 cmikeh2 2 years ago
HeyangQin HeyangQin requested a review from arashb arashb 2 years ago
cmikeh2 Merge branch 'master' into cholmes/int4-quant-accuracy
3102ac0c
cmikeh2
cmikeh2 approved these changes on 2023-04-11
HeyangQin HeyangQin enabled auto-merge (squash) 2 years ago
HeyangQin update unit test for quantization
e5fd151c
HeyangQin HeyangQin requested a review from mrwyattii mrwyattii 2 years ago
HeyangQin HeyangQin requested a review from tjruwase tjruwase 2 years ago
disabled auto-merge 2 years ago
Manually disabled by user
HeyangQin fix format
38438e99
HeyangQin attempt to fix format
a01b95dc
tjruwase Merge branch 'master' into cholmes/int4-quant-accuracy
45b602fd
HeyangQin Merge branch 'master' into cholmes/int4-quant-accuracy
dd931819
HeyangQin Merge branch 'master' into cholmes/int4-quant-accuracy
fe8d6731
HeyangQin HeyangQin enabled auto-merge (squash) 2 years ago
HeyangQin Merge branch 'master' into cholmes/int4-quant-accuracy
9c3b5f96
HeyangQin Merge branch 'master' into cholmes/int4-quant-accuracy
2735ad8a
HeyangQin Merge branch 'master' into cholmes/int4-quant-accuracy
7a9e63a1
disabled auto-merge 2 years ago
Manually disabled by user
mrwyattii mrwyattii merged 48297c48 into master 2 years ago
mrwyattii mrwyattii deleted the cholmes/int4-quant-accuracy branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone