DeepSpeed
Add support of Microsoft Phi-2 model to DeepSpeed-FastGen
#4812
Merged
Overview
Commits
9
Changes
View On GitHub

Add support of Microsoft Phi-2 model to DeepSpeed-FastGen #4812

mrwyattii merged 9 commits into master from arashb/phi-2
arashb
arashb arashb changed the title Add Microsoft Phi-2 support to DeepSpeed-FastGen Add support of Microsoft Phi-2 model to DeepSpeed-FastGen 2 years ago
arashb arashb force pushed from 646ea437 to 88313673 2 years ago
arashb arashb force pushed from 88313673 to 8fa6628d 2 years ago
arashb arashb force pushed from 8fa6628d to 61d0126a 2 years ago
arashb arashb force pushed from 61d0126a to c1ec90ca 2 years ago
arashb arashb force pushed from c1ec90ca to a42e8690 2 years ago
cmikeh2 cmikeh2 changed the base branch from master to cholmes/mixtral-fastgen-support 2 years ago
Base automatically changed from cholmes/mixtral-fastgen-support to master 2 years ago
arashb Add support of Phi-2 model to DeepSpeed-FastGen
4683001c
cmikeh2 Explicit rotary dim, fixes
ddc7a08d
cmikeh2 I am my own worst enemy
b66ee435
cmikeh2 cmikeh2 force pushed from dcf4874d to b66ee435 2 years ago
cmikeh2 cmikeh2 marked this pull request as ready for review 2 years ago
cmikeh2 cmikeh2 requested a review from mrwyattii mrwyattii 2 years ago
cmikeh2 cmikeh2 requested a review from awan-10 awan-10 2 years ago
cmikeh2 cmikeh2 requested a review from cmikeh2 cmikeh2 2 years ago
cmikeh2 cmikeh2 requested a review from tjruwase tjruwase 2 years ago
cmikeh2 cmikeh2 requested a review from loadams loadams 2 years ago
arashb Update DeepSpeed-FastGen README.md to include Phi-2 model
31a528bd
mrwyattii
mrwyattii requested changes on 2023-12-21
arashb Update blog to include Mixtra model.
0a2c03bf
arashb renaming the files and adding more unit tests
a5ddc4dc
arashb Merge branch 'master' into arashb/phi-2
d2cea367
mrwyattii
mrwyattii approved these changes on 2023-12-21
arashb Update deepspeed/inference/v2/model_implementations/phi/policy.py
ee95535f
mrwyattii Merge branch 'master' into arashb/phi-2
fcee6797
mrwyattii mrwyattii merged 83427253 into master 2 years ago
mrwyattii mrwyattii deleted the arashb/phi-2 branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum