DeepSpeed
Add support for Phi-3 small to FastGen
#5614
Merged
Overview
Commits
10
Changes
View On GitHub

Add support for Phi-3 small to FastGen #5614

loadams merged 10 commits into adk9/phi3-inference from adk9/phi3-small
adk9
adk9 adk9 force pushed from e1accbb3 to 542d2a2e 1 year ago
adk9 adk9 force-pushed the adk9/phi3-inference branch from dd4868fe to 702bad7e 1 year ago
adk9 Add support for the Phi-3 small model
3c4fca94
adk9 Tie lm_head to embedding weights
0ce02a9f
adk9 Add mup_embedding_multiplier
230615bd
adk9 adk9 force pushed from 542d2a2e to 230615bd 1 year ago
loadams Merge branch 'adk9/phi3-inference' into adk9/phi3-small
ab6e29b6
loadams Formatting fixes
e95086f3
loadams Revert "Formatting fixes"
6f1e1fc4
loadams Fix merge conflicts
08f24443
loadams Merge branch 'adk9/phi3-inference' into adk9/phi3-small
13bc14aa
loadams Format fixes
857c7798
loadams Merge branch 'adk9/phi3-inference' into adk9/phi3-small
f41470c0
loadams loadams marked this pull request as ready for review 1 year ago
loadams loadams requested a review from awan-10 awan-10 1 year ago
loadams loadams merged cfa99d40 into adk9/phi3-inference 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum