W7 llm_compressor presets
#2273

Merged

Commits

fix: asymmetric zero-point packing, format-scoped 8-bit asym, W5/W6/W7 llm_compressor presets

avtc committed 14 days ago
refactor: replace the allow_w8_asym argument with the AR_ALLOW_W8_ASYM env

avtc committed 14 days ago
fix: model-free format handling and asymmetric zero-point packing

avtc committed 13 days ago