text-generation-inference
[gaudi] Deepseek v2 mla and add ep to unquantized moe
#3287
Merged
Overview
Commits
2
Changes
View On GitHub

[gaudi] Deepseek v2 mla and add ep to unquantized moe #3287

regisss merged 2 commits into huggingface:main from sywangyi:deepseek_v2_mla
sywangyi
sywangyi applied mla to deepseek v2
433029e5
sywangyi add ep to improve perf
82a9435a
sywangyi
sywangyi sywangyi changed the title Deepseek v2 mla Deepseek v2 mla and add ep to unquantized moe 1 year ago
regisss
regisss approved these changes on 2025-07-07
regisss regisss changed the title Deepseek v2 mla and add ep to unquantized moe [gaudi] Deepseek v2 mla and add ep to unquantized moe 1 year ago
regisss regisss merged ebb26f0c into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum