microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into fastgen-blog

jeffra committed 2 years ago

Verified c3bb1651

DeepSpeed-FastGen (#4604)

cmikeh2 committed 2 years ago

Verified 38b41dff

Pin transformers in nv-inference (#4606)

loadams committed 2 years ago

Verified 737ef296

minor word changes

jeffra committed 2 years ago

c67deb8e

Add files via upload

jeffra committed 2 years ago

Verified 8e03ec9d

jeffra committed 2 years ago

Verified ba6e99f4

Update README.md

cmikeh2 committed 2 years ago

Verified 4828d71d

swap colors in figures

Masahiro Tanaka committed 2 years ago

d937318f

Update version.txt after 0.11.2 release (#4609)

mrwyattii committed 2 years ago

Verified 2cbfdc70

jeffra committed 2 years ago

87d5c892

Disable CPU inference on PRs (#4590)

loadams committed 2 years ago

Verified f0604078

[docs] fix deepspeed.ai links

jeffra committed 2 years ago

4199dc25

[docs] paper updates (#4584)

jeffra committed 2 years ago

Verified 45b07bf9

Public update (#4583)

yaozhewei committed 2 years ago

Verified ff529c91

Don't check overflow for bf16 data type (#4512)

BacharL committed 2 years ago

Verified 244040c1

fix multiple definition while building evoformer (#4556)

fecet committed 2 years ago

Verified 8f168c2f

Added __HIP_PLATFORM_AMD__=1 (#4570)

rraminen committed 2 years ago

Verified 764f5b07

Remove PP Grad Tail Check (#2538)

Quentin-Anthony committed 2 years ago

Verified 3589cad8

engine.py - save_checkpoint: only rank-0 should create the save dir (#4536)

nelyahu committed 2 years ago

Verified b891ec2a

Fix the sequence-parallelism for the dense model architecture (#4530)

RezaYazdaniAminabadi committed 2 years ago

Verified ec029e76

[AutoTP] Make AutoTP work when num_heads not divisible by number of workers (#4011)

delock committed 2 years ago

Verified f15cccfa

Enable universal checkpoint for zero stage 1 (#4516)

tjruwase committed 2 years ago

Verified 8fdd9b35

Add missing RocBlas include (#4557)

loadams committed 2 years ago

Verified 869629c2

pipe engine _aggregate_total_loss: more efficient loss concatenation (#4327)

nelyahu committed 2 years ago

Verified a02de228

Fix RTD builds (#4558)

mrwyattii committed 2 years ago

Verified 0f2338f7

ROCm 6.0 prep changes (#4537)

loadams committed 2 years ago

Verified e2383511

[docs] paper updates (#4543)

jeffra committed 2 years ago

Verified 488f7e2d

turn off I_MPI_PIN for impi launcher (#4531)

delock committed 2 years ago

Verified 04cd6af1

Switch from HIP_PLATFORM_HCC to HIP_PLATFORM_AMD (#4539)

loadams committed 2 years ago

Verified c7724c61

[docs] ZeRO infinity slides and blog (#4542)

jeffra committed 2 years ago

Verified a5b1cb1e

Older