auto-round
enable llava int4 inference with autoround format
#237
Merged

Loading