vllm
c982ac57 - [Bugfix] Fix FP16 overflow for DeepSeek V2 (#13232)

Commit

1 year ago

[Bugfix] Fix FP16 overflow for DeepSeek V2 (#13232) Signed-off-by: Yida Wu <yida.wu@amd.com>

References

Author

Concurrensee

Parents