PR #1180 Add FP8 KV Support for DS

Add FP8 KV Support for DS #1180

yiliu30 merged 6 commits into main from ds-fp8kv

detect mla

f32b2bc4

fix ds load

2ce96805

[pre-commit.ci] auto fixes from pre-commit.com hooks

af3fe70f

yiliu30 added this to the 1.0.0 milestone 71 days ago

yiliu30 requested a review from

chensuyue 70 days ago

yiliu30 requested a review from

mengniwang95 70 days ago

Merge branch 'main' into ds-fp8kv

b574909d

mengniwang95 commented on 2025-12-25

Merge branch 'main' into ds-fp8kv

1714df40

mengniwang95 approved these changes on 2025-12-25

yiliu30 added vllm-ext

Merge branch 'main' into ds-fp8kv

8eb01376

yiliu30 merged d390de00 into main 67 days ago

yiliu30 deleted the ds-fp8kv branch 67 days ago

Reviewers

mengniwang95

chensuyue

Assignees

No one assigned

Labels

vllm-ext

Milestone

1.0.0