PR #13232 [Bugfix] Fix FP16 overflow for DeepSeek V2

[Bugfix] Fix FP16 overflow for DeepSeek V2 #13232

vllm-bot merged 1 commit into vllm-project:main from Concurrensee:Deepseek_V2_fp16_fix

Concurrensee force pushed 1 year ago

robertgshaw2-redhat commented on 2025-02-21

Concurrensee force pushed 1 year ago

tlrmchlsmth commented on 2025-02-21

fix FP16 overflow for DSv2

09fd67fa

Concurrensee force pushed to 09fd67fa 1 year ago

mgoin approved these changes on 2025-03-10

mgoin added bug

mgoin added ready

robertgshaw2-redhat added force-merge

vllm-bot merged c982ac57 into main 1 year ago

Reviewers

mgoin

tlrmchlsmth

robertgshaw2-redhat

Assignees

No one assigned

Labels

bug ready

Milestone

No milestone