microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into loadams/update-flake8

loadams committed 1 year ago

Verified f1a9cc12

Add COMMITTER file (#6741)

tjruwase committed 1 year ago

Verified b7e2ff50

Update flake8 version

loadams committed 1 year ago

0e159811

Update GH hosted workflows to 24.04 (#6717)

loadams committed 1 year ago

Verified 08555662

Update version.txt after 0.15.4 release (#6731)

loadams committed 1 year ago

Verified 057d25be

Switch what versions of python are supported (#5676)

loadams committed 1 year ago

Verified a1b0c35a

Update flake8 version (#6722)

loadams committed 1 year ago

Verified 3beda32e

Update yapf version (#6721)

loadams committed 1 year ago

Verified d2a47189

Use one param coordinator for both train/inference scenarios (#6662)

tohtana committed 1 year ago

Verified 351569dd

[Bug Fix] Support threads_per_head < 64 for wavefront size of 64 (#6622)

jagadish-amd committed 1 year ago

Verified 2b41d621

Pin transformers to 4.45.2 in nv-ds-chat workflow (#6710)

loadams committed 1 year ago

Verified 6c08b7f9

Update URL in README Pipeline Status for Huawei Ascend NPU (#6706)

xuedinge233 committed 1 year ago

Verified 9068acb6

Explictly set device when reusing dist env (#6696)

tohtana committed 1 year ago

Verified b24dfa9d

Free memory in universal checkpointing tests (#6693)

tohtana committed 1 year ago

Verified 95ea95fc

fix memcpy issue on backward for zero-infinity (#6670)

xylian86 committed 1 year ago

Verified ff1c5435

Add attribute check to support git-base autotp (#6688)

Yejing-Lai committed 1 year ago

Verified c7f58c89

Update checkout action to latest version (#5021)

loadams committed 1 year ago

Verified 9b547313

Fix training of pipeline based peft's lora model (#5477)

xuanhua committed 1 year ago

Verified e4a247ed

Remove packages that no longer need to be updated in the latest container (#6682)

loadams committed 1 year ago

Verified 07cac9e0

Update base docker image for A6000 GPU tests (#6681)

loadams committed 1 year ago

Verified 0e11b081

Update gaudi2 docker version to latest release (1.18) (#6648)

raza-sikander committed 1 year ago

Verified e6357c28

Update Gaudi2 docker image (#6677)

loadams committed 1 year ago

Verified b3e95946

Add support for H100/sm_90 arch compilation (#6669)

loadams committed 1 year ago

Verified 229960a5

Update profiler registration check (#6668)

loadams committed 1 year ago

Verified 54903e09

Add fallback for is_compiling (#6663)

tohtana committed 1 year ago

Verified 24285d6c

sequence parallel for uneven heads (#6392)

inkcherry committed 1 year ago

Verified 5fb71c0a

Fix dynamo issue (#6527)

oraluben committed 1 year ago

Verified 3d5cf739

fix init_device_mesh for torch 2.4 (#6614)

Lzhang-hub committed 1 year ago

Verified 6e6563d3

Add attribute check for language_model when replace last linear module (#6650)

Yejing-Lai committed 1 year ago

Verified e06bb518

Fix expert grad scaling problem with ZeRO optimizer (#6546)

wyooyw committed 1 year ago

Verified b647fb24

Older