DeepSpeed
Deepspeed-Ulysses blog
#4201
Merged
Overview
Commits
117
Changes
View On GitHub

Deepspeed-Ulysses blog #4201

jeffra merged 117 commits into master from deepspeed-ulysses
samadejacobs
HeyangQin zero++ tutorial PR (#3783)
df1859d6
zhiruiluo [Fix] _conv_flops_compute when padding is a str and stride=1 (#3169)
d81a6ad6
cli99 fix interpolate flops compute (#3782)
a8c182a4
CaffreyR use `Flops Profiler` to test `model.generate()` (#2515)
c4c442f0
jeffra revert PR #3611 (#3786)
fc9e1ee0
jeffra bump to 0.9.6
40045dc7
HeyangQin ZeRO++ chinese blog (#3793)
49a0a1bb
jeffra remove staging trigger (#3792)
2c62cb4c
stephen-youn DeepSpeed-Triton for Inference (#3748)
4dc65f7b
HeyangQin ZeRO++ (#3784)
e1119d8b
HeyangQin adding zero++ to navigation panel of deepspeed.ai (#3796)
01b843aa
tohtana Add ZeRO++ Japanese blog (#3797)
319b64ed
cli99 Bug Fixes for autotuner and flops profiler (#1880)
b4a2c0af
cmikeh2 Missing strided copy for gated MLP (#3788)
b7e1010b
jomayeri Requires grad checking. (#3789)
e5b1eadb
jeffra bump to 0.10.0
9c756cf8
rraminen Fix Bug in transform.cu (#3534)
a204edc7
stephen-youn bug fix: triton importing error (#3799)
f6e2e38b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c1a7d3cc
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
65ed5483
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
d7ac3296
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
83f1102e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
16555b27
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
9d7b654a
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c121f900
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f6b2962c
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
dd6bb042
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
6e5a1f1d
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
1fbbbbf2
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
e44eb862
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
26d88237
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
83e1752b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
b5446a2f
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
7f9b2fa5
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
9fb79a34
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
9643da29
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
464f99ac
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
fbf50684
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
208870a0
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
62b47f39
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c5f62c34
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
78528ae7
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
b52c4079
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
dfe3b823
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f086c395
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
04718e4a
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
63db2865
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f32c9476
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
3b7c5834
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
7963bc7e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
441fffe4
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
72f37aba
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f5eb5df3
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
e5956215
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
427d9eb2
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
e9708d6a
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
6da3e487
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c031179b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
0de04b3e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
a733676d
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
fd2ca3a5
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
af181e5e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
68935e8f
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
37b77431
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
b8153eb4
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
8b9815fb
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
79781ef0
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
2b3664ca
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f6ded65c
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
cea2dd9e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
30626f0f
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
ccb6817f
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
a20815b2
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
2d8c49a7
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
762a1bb8
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
8ac993f2
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
fabf2c0b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
cc0b0f1b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
fd1cede1
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f694a930
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
4d29d5ec
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
636e5e46
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
a39b6e26
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
de64c549
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
cf479bf9
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
df4f25c8
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
38bb5523
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
e86e1c5e
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
95643e3b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
19018b6d
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
b8866823
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
7948971c
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
9242d366
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c51a072d
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
c816d506
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
d9b16722
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
a746aca8
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
f0afcf3b
jeffra Merge branch 'master' of github.com:microsoft/DeepSpeed
956ed2fa
Add blog text and related media
3be23d72
Minor cleanup of text
bb23350d
samadejacobs Title formatting
56269a5c
samadejacobs Formatting and figures centering
659b6a62
samadejacobs More formatting, resize figures, add links
5aa90d2e
samadejacobs image resizing
a377599f
samadejacobs Add link to tutorial
dcc503cf
samadejacobs Replace DS Sequence with DS-Ulysses in all figs
1661cf6e
samadejacobs Name clean up
1a3c01a8
samadejacobs Remove deprecated figs
48d4f502
samadejacobs Some edit and clean up
70ba7497
samadejacobs Update README.md
8931c3ac
samadejacobs Merge branch 'master' into deepspeed-ulysses
4da253fd
awan-10
awan-10 approved these changes on 2023-08-23
samadejacobs Update README.md
f9a52ccd
awan-10 fix format.
b908f80f
samadejacobs Merge branch 'master' into deepspeed-ulysses
47d7415b
samadejacobs fig
76498f3e
jeffra Merge branch 'master' into deepspeed-ulysses
f438a866
jeffra jeffra merged 4e5d39fe into master 2 years ago
jeffra jeffra deleted the deepspeed-ulysses branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum