text-generation-inference
add ipex moe implementation to support Mixtral and PhiMoe
#2707
Merged

add ipex moe implementation to support Mixtral and PhiMoe #2707

danieldk merged 8 commits into huggingface:main from sywangyi:moe
sywangyi
sywangyi add ipex moe implementation to support Mixtral and PhiMoe
d9a8bbc1
sywangyi sywangyi marked this pull request as draft 1 year ago
sywangyi
sywangyi Merge branch 'main' into moe
d2f28687
Narsil
sywangyi update to ipex xpu 2.5
11080516
sywangyi
sywangyi Merge branch 'main' into moe
3d4c50f0
sywangyi torch has xpu support in 2.5
6becab5d
sywangyi sywangyi marked this pull request as ready for review 1 year ago
sywangyi
sywangyi fix oneapi basekit version
1639152c
sywangyi
sywangyi
sywangyi Merge branch 'main' into moe
e0e39fa0
danieldk
danieldk
danieldk commented on 2024-11-18
sywangyi Apply suggestions from code review
53b6f6e6
danieldk
danieldk approved these changes on 2024-11-18
danieldk danieldk merged a5ecd6e5 into main 1 year ago
sywangyi sywangyi deleted the moe branch 256 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone