auto-round
feat: add NVFP4 static KV cache quantization support
#2366

Merged

Commits

feat: add NVFP4 static KV cache quantization support

yiliu30 committed 60 days ago
Merge branch 'main' into feat/nvfp4-kv-cache

yiliu30 committed 60 days ago
fix: address NVFP4 KV review feedback

yiliu30 committed 59 days ago

Loading