DeepSpeed
DeepSpeed Ulysses release
#4198
Merged

DeepSpeed Ulysses release #4198

jeffra merged 93 commits into master from staging-ds-seq-v1
samadejacobs
HeyangQin zero++ tutorial PR (#3783)
df1859d6
zhiruiluo [Fix] _conv_flops_compute when padding is a str and stride=1 (#3169)
d81a6ad6
cli99 fix interpolate flops compute (#3782)
a8c182a4
CaffreyR use `Flops Profiler` to test `model.generate()` (#2515)
c4c442f0
jeffra revert PR #3611 (#3786)
fc9e1ee0
jeffra bump to 0.9.6
40045dc7
HeyangQin ZeRO++ chinese blog (#3793)
49a0a1bb
jeffra remove staging trigger (#3792)
2c62cb4c
stephen-youn DeepSpeed-Triton for Inference (#3748)
4dc65f7b
HeyangQin ZeRO++ (#3784)
e1119d8b
HeyangQin adding zero++ to navigation panel of deepspeed.ai (#3796)
01b843aa
tohtana Add ZeRO++ Japanese blog (#3797)
319b64ed
cli99 Bug Fixes for autotuner and flops profiler (#1880)
b4a2c0af
cmikeh2 Missing strided copy for gated MLP (#3788)
b7e1010b
jomayeri Requires grad checking. (#3789)
e5b1eadb
jeffra bump to 0.10.0
9c756cf8
rraminen Fix Bug in transform.cu (#3534)
a204edc7
stephen-youn bug fix: triton importing error (#3799)
f6e2e38b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c1a7d3cc
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
65ed5483
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
d7ac3296
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
83f1102e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
16555b27
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
9d7b654a
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c121f900
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f6b2962c
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
dd6bb042
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
6e5a1f1d
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
1fbbbbf2
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
e44eb862
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
26d88237
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
83e1752b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
b5446a2f
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
7f9b2fa5
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
9fb79a34
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
9643da29
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
464f99ac
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
fbf50684
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
208870a0
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
62b47f39
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c5f62c34
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
78528ae7
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
b52c4079
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
dfe3b823
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f086c395
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
04718e4a
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
63db2865
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f32c9476
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
3b7c5834
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
7963bc7e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
441fffe4
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
72f37aba
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f5eb5df3
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
e5956215
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
427d9eb2
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
e9708d6a
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
6da3e487
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c031179b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
0de04b3e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
a733676d
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
fd2ca3a5
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
af181e5e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
68935e8f
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
37b77431
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
b8153eb4
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
8b9815fb
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
79781ef0
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
2b3664ca
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f6ded65c
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
cea2dd9e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
30626f0f
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
ccb6817f
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
a20815b2
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
2d8c49a7
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
762a1bb8
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
8ac993f2
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
fabf2c0b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
cc0b0f1b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
fd1cede1
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f694a930
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
4d29d5ec
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
636e5e46
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
a39b6e26
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
de64c549
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
cf479bf9
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
df4f25c8
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
38bb5523
samadejacobs DeepSpeed Sequence (#535)
368976fc
samadejacobs samadejacobs requested a review from jeffra jeffra 2 years ago
samadejacobs samadejacobs requested a review from tjruwase tjruwase 2 years ago
samadejacobs samadejacobs requested a review from samyam samyam 2 years ago
samadejacobs samadejacobs requested a review from mrwyattii mrwyattii 2 years ago
samadejacobs samadejacobs requested a review from awan-10 awan-10 2 years ago
samadejacobs Merge branch 'master' into staging-ds-seq-v1
f7f34157
samadejacobs samadejacobs enabled auto-merge 2 years ago
awan-10
awan-10 approved these changes on 2023-08-23
jeffra
jeffra commented on 2023-08-23
jeffra
jeffra approved these changes on 2023-08-23
awan-10 fix format.
13793ce6
awan-10 remove debug print.
42c2cf0c
awan-10 undo mistakenly removed license.
7c073970
samadejacobs Merge branch 'master' into staging-ds-seq-v1
0e06bacc
jeffra jeffra merged a855405e into master 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone