microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into jomayeri/zero-grad-accum

jomayeri committed 2 years ago

Verified 14827378

Handle hanged tests in CI (#2808)

mrwyattii committed 2 years ago

Verified 349f845b

Merge branch 'master' into jomayeri/zero-grad-accum

jomayeri committed 2 years ago

Verified cdbf012e

jomayeri committed 2 years ago

3d6ba3cc

Fix Slurm launcher user args (#2806)

loadams committed 2 years ago

Verified d038dbd2

Add user defined launcher args for PDSH launcher (#2804)

loadams committed 2 years ago

Verified 4af1f76a

Updating optimizer sanity check in engine.

jomayeri committed 2 years ago

a1f9ab21

Cleanup comments

jomayeri committed 2 years ago

1893afb1

Zero gradient accumulation in separte data type

jomayeri committed 2 years ago

3db02a3d

starting zero 1/2 grad accum changes

jomayeri committed 2 years ago

32a66b95

Add container load checkpoint error reporting + refactor (#2792)

lekurile committed 2 years ago

Verified 10f3c301

Enable page-locked tensors without CUDA (#2775)

tjruwase committed 2 years ago

Verified c9b08888

remove outdated comment (#2786)

stas00 committed 2 years ago

Verified d323abd8

Fixing broken link to azureml-examples recipes (#2795)

rtanase committed 2 years ago

Verified f376daea

Common location to install libaio-dev (#2779)

tjruwase committed 2 years ago

Verified 7d9fae4d

Container param cleanup + remove qkv_merging (#2780)

lekurile committed 2 years ago

Verified 0a73e6e6

Reset KV-cache at the beginning of text-generation (#2669)

RezaYazdaniAminabadi committed 2 years ago

Verified 9f41ffe4

add support for hjson config files (#2783)

mrwyattii committed 2 years ago

Verified 4079077c

Fix Checkpoint-loading with Meta-tensor (#2781)

RezaYazdaniAminabadi committed 2 years ago

Verified 2c6e8194

Fix broken kernel inject bug (#2776)

molly-smith committed 2 years ago

Verified c5b983e9

fix upsample flops compute by skipping unused kargs (#2773)

cli99 committed 2 years ago

Verified b5750b64

some fix in flops_profiler (#2068)

lucasleesw committed 2 years ago

Verified e2a31d80

Fix for diffusers v0.12.0 (#2753)

mrwyattii committed 2 years ago

Verified ef6a958e

Pin minimum `packaging` requirement (#2771)

carmocca committed 2 years ago

Verified 02e95e6a

Refactor/Pydantify monitoring config (#2640)

mrwyattii committed 2 years ago

Verified d923f7c8

Fix hardcoded instances to fp16 in optimizer creation log messages to the correct dtype. (#2743)

loadams committed 2 years ago

Verified 86477538

Add links to new azureML examples (#2756)

cassieesvelt committed 2 years ago

Verified 1db4ade3

Bing/formatting correction (#2764)

xiexbing committed 2 years ago

Verified 8d3b42c2

Add environment variable to make nvcc compilation more verbose (#2759)

cmikeh2 committed 2 years ago

Verified 258d2831

Skip test_bias_gelu unit test if torch < 1.12 (#2754)

lekurile committed 2 years ago

Verified cc3d7cb9

Older