Enhance model-free quantization with improved error handling and shard management #2566
Enhance model-free quantization with improved error handling and shar…
8be22508
[pre-commit.ci] auto fixes from pre-commit.com hooks
cb734cdb
Enhance NVFP4 E5M3 GS quantization with global scale overrides, remov…
9d810fb0
[pre-commit.ci] auto fixes from pre-commit.com hooks
4bcf58e0
feat: Enhance FP8 tensor handling and add cross-shard global scale co…
78e057de
feat: Add support for cross-attention projections in NVFP4 fused grou…
eace9e97
feat: Enhance quantization process with precomputed global scale over…
2fdcd097
xin3he
merged
2679ca9a
into main 7 days ago
xin3he
deleted the xinhe/11-2 branch 7 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub