microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into tohtana/model_declaration_in_init_context

tohtana committed 2 years ago

Verified 985b1a04

merged master and resolved conflict

Masahiro Tanaka committed 2 years ago

70801aea

July 2022 update: chrome://tracing is deprecated, and by default will redirect to https://ui.perfetto.dev. (see https://chromium.googlesource.com/catapult/+/refs/heads/main/tracing/docs/perfetto.md) (#3805)

keyboardAnt committed 2 years ago

Verified a63f9152

Revert "Prevent hangs in CI during parallel run compilation (#2844)" (#3817)

jeffra committed 2 years ago

Verified 6102d128

Prevent hangs in CI during parallel run compilation (#2844)

mrwyattii committed 2 years ago

Verified 2b2be85f

Add an api in deepspeed engine for adjusting micro batch size during training (#3773)

kisseternity committed 2 years ago

Verified 1b888399

bug fix: triton importing error (#3799)

stephen-youn committed 2 years ago

bafaf3c0

Fix Bug in transform.cu (#3534)

rraminen committed 2 years ago

aebdfb3b

jeffra committed 2 years ago

d33f1f85

Requires grad checking. (#3789)

jomayeri committed 2 years ago

5eb25986

Missing strided copy for gated MLP (#3788)

cmikeh2 committed 2 years ago

c86e4e31

Bug Fixes for autotuner and flops profiler (#1880)

cli99 committed 2 years ago

c80855b5

Add ZeRO++ Japanese blog (#3797)

tohtana committed 2 years ago

b0752b2e

adding zero++ to navigation panel of deepspeed.ai (#3796)

HeyangQin committed 2 years ago

94479e2b

HeyangQin committed 2 years ago

d18aa2c7

DeepSpeed-Triton for Inference (#3748)

stephen-youn committed 2 years ago

69d1b9f9

remove staging trigger (#3792)

jeffra committed 2 years ago

52c6baa9

ZeRO++ chinese blog (#3793)

HeyangQin committed 2 years ago

b3320940

jeffra committed 2 years ago

6e4faf86

revert PR #3611 (#3786)

jeffra committed 2 years ago

80ccaf9c

use `Flops Profiler` to test `model.generate()` (#2515)

CaffreyR committed 2 years ago

24c7d7f1

fix interpolate flops compute (#3782)

cli99 committed 2 years ago

a76cced3

[Fix] _conv_flops_compute when padding is a str and stride=1 (#3169)

zhiruiluo committed 2 years ago

06240868

zero++ tutorial PR (#3783)

HeyangQin committed 2 years ago

d2bf38d6

Add H100 workflow and status badge. (#3754)

loadams committed 2 years ago

Verified dd593410

Update deepspeed-chat/japanese/README.md (#3765)

eltociear committed 2 years ago

Verified 1491e14e

Fix url in getting-started guide (docs) (#3768)

acforvs committed 2 years ago

Verified 044dd0e2

fix ccl_backend and residual_add problems (#3642)

Dino Chen committed 2 years ago

Verified 3f5e4931

Account for expert parameters when calculating the total number of parameters in the model (#3720)

alito committed 2 years ago

Verified 9a8f6a1d

add Chinese Zhihu social account (#3755)

conglongli committed 2 years ago

Verified b692d236

Older