DeepSpeed
Add HE support for the rest of model containers
#3191
Merged
Overview
Commits
13
Changes
View On GitHub

Add HE support for the rest of model containers #3191

jeffra merged 13 commits into master from ChatGPT/HE-support
RezaYazdaniAminabadi
add HE support for the rest of model containers
36682403
fix some issues for gpt-j and neox
b7f795d3
lekurile
lekurile approved these changes on 2023-04-12
fix update qkv
02feb845
mrwyattii
mrwyattii commented on 2023-04-13
some refactor & fix issues
e49b1508
RezaYazdaniAminabadi Merge branch 'master' into ChatGPT/HE-support
6a6fd08c
fix some issues with running neox-20b with hybrid-engine
2c7f6c7b
use the tp-sharded tensor and mp_group form mpu if it is not None
10f9c9ef
fix qkv partitioning
66613fe4
RezaYazdaniAminabadi Merge branch 'master' into ChatGPT/HE-support
0f80942f
RezaYazdaniAminabadi RezaYazdaniAminabadi marked this pull request as ready for review 2 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 2 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 2 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 2 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cmikeh2 cmikeh2 2 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from arashb arashb 2 years ago
cmikeh2
cmikeh2 approved these changes on 2023-05-01
fix formatting
f1317df2
Merge branch 'ChatGPT/HE-support' of github.com:microsoft/DeepSpeed i…
0c7eef5d
fix bloom policy
ac6a70bb
jeffra
jeffra approved these changes on 2023-05-01
jeffra Merge branch 'master' into ChatGPT/HE-support
6f7b5e53
jeffra jeffra merged 3e856464 into master 2 years ago
jeffra jeffra deleted the ChatGPT/HE-support branch 2 years ago
brian-fb

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum