Fix nvfp4&fp8 packing ram issue, refine all exporting format ram release for origin layer #1129
fix nvfp4 ram issue
f66b1559
fix pack_layer for nvfp/mxfp
18244a6c
[pre-commit.ci] auto fixes from pre-commit.com hooks
c0c26d08
wenhuach21
added this to the 0.9.3 milestone 343 days ago
fix fp8 packing weight release, refine tensor ram release for all pac…
8070f687
WeiweiZhang1
changed the title Fix nvfp4 ram issue Fix nvfp4&fp8 packing ram issue, refine all exporting format ram release for origin layer 343 days ago
yiliu30
merged
77712681
into main 342 days ago
yiliu30
deleted the fix-nvfp4-oom branch 342 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub