vllm
[Model] Add Deepseek V3 fp8_w8a8 configs for B200
#12707

Merged

[Model] Add Deepseek V3 fp8_w8a8 configs for B200 #12707

simon-mo merged 1 commit into vllm-project:main from kushanam:blackwell_configs

add DSv3 fp8_w8a8 configs for b200

0be5044b

kushanam requested a review from

mgoin 322 days ago

kushanam requested a review from

robertgshaw2-redhat 322 days ago

kushanam requested a review from

tlrmchlsmth 322 days ago

robertgshaw2-redhat approved these changes on 2025-02-03

robertgshaw2-redhat enabled auto-merge (squash) 322 days ago

github-actions added ready

mgoin approved these changes on 2025-02-03

tlrmchlsmth approved these changes on 2025-02-03

simon-mo changed the title ~~add DSv3 fp8_w8a8 configs for b200~~ [Model] Add Deepseek V3 fp8_w8a8 configs for B200 322 days ago

disabled auto-merge 322 days ago
Manually disabled by user

simon-mo merged 4797dad3 into main 322 days ago

Reviewers

tlrmchlsmth

mgoin

robertgshaw2-redhat

Assignees

No one assigned

Labels

ready

Milestone

No milestone