vllm
[AMD][FP8] Using MI300 FP8 format on ROCm for block_quant
#12134
Merged
Overview
Commits
1
Changes
View On GitHub

[AMD][FP8] Using MI300 FP8 format on ROCm for block_quant #12134

mgoin merged 1 commit into vllm-project:main from ROCm:deepseek_v3_rocm_weights
gshtras
gshtras Requantizing fp8 weights into NANOO format on rocm platform. Conditio…
1d54e3cb
github-actions
mgoin
mgoin approved these changes on 2025-01-17
mgoin mgoin added ready
gshtras
mgoin mgoin enabled auto-merge (squash) 324 days ago
mgoin mgoin merged b5b57e30 into main 324 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum