Fix int4 quantized model cannot work with cpu (#39724)
* Fix int4 quantized model cannot work with cpu
Signed-off-by: yuanwu <yuan.wu@intel.com>
* Update the comments
Signed-off-by: yuanwu <yuan.wu@intel.com>
* update
Signed-off-by: yuanwu <yuan.wu@intel.com>
* update
Signed-off-by: yuanwu <yuan.wu@intel.com>
---------
Signed-off-by: yuanwu <yuan.wu@intel.com>
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
