microsoft/DeepSpeed

Pull Requests Commits

AIO File Offsets (#6641)

jomayeri committed 1 year ago

Verified b692cdea

add zero3 ```module_granularity_threshold ``` to zero optimization. (#6649)

inkcherry committed 1 year ago

Verified 7af3a4be

Add data type check for bf16 (#6742)

hwchen2017 committed 1 year ago

Verified 73d974ee

Add Domino code (#6733)

zhangsmallshark committed 1 year ago

Verified fabab197

Fix Type Name Inconsistency & Typo in cpu_adam (#6732)

xylian86 committed 1 year ago

Verified 99e9cbed

Update AMD apex version (#6739)

loadams committed 1 year ago

Verified b45ca263

Add COMMITTER file (#6741)

tjruwase committed 1 year ago

Verified b7e2ff50

Update GH hosted workflows to 24.04 (#6717)

loadams committed 1 year ago

Verified 08555662

Update version.txt after 0.15.4 release (#6731)

loadams committed 1 year ago

Verified 057d25be

Switch what versions of python are supported (#5676)

loadams committed 1 year ago

Verified a1b0c35a

Update flake8 version (#6722)

loadams committed 1 year ago

Verified 3beda32e

Update yapf version (#6721)

loadams committed 1 year ago

Verified d2a47189

Use one param coordinator for both train/inference scenarios (#6662)

tohtana committed 1 year ago

Verified 351569dd

[Bug Fix] Support threads_per_head < 64 for wavefront size of 64 (#6622)

jagadish-amd committed 1 year ago

Verified 2b41d621

Pin transformers to 4.45.2 in nv-ds-chat workflow (#6710)

loadams committed 1 year ago

Verified 6c08b7f9

Update URL in README Pipeline Status for Huawei Ascend NPU (#6706)

xuedinge233 committed 1 year ago

Verified 9068acb6

Explictly set device when reusing dist env (#6696)

tohtana committed 1 year ago

Verified b24dfa9d

Free memory in universal checkpointing tests (#6693)

tohtana committed 1 year ago

Verified 95ea95fc

fix memcpy issue on backward for zero-infinity (#6670)

xylian86 committed 1 year ago

Verified ff1c5435

Add attribute check to support git-base autotp (#6688)

Yejing-Lai committed 1 year ago

Verified c7f58c89

Update checkout action to latest version (#5021)

loadams committed 1 year ago

Verified 9b547313

Fix training of pipeline based peft's lora model (#5477)

xuanhua committed 1 year ago

Verified e4a247ed

Remove packages that no longer need to be updated in the latest container (#6682)

loadams committed 1 year ago

Verified 07cac9e0

Update base docker image for A6000 GPU tests (#6681)

loadams committed 1 year ago

Verified 0e11b081

Update gaudi2 docker version to latest release (1.18) (#6648)

raza-sikander committed 1 year ago

Verified e6357c28

Update Gaudi2 docker image (#6677)

loadams committed 1 year ago

Verified b3e95946

Add support for H100/sm_90 arch compilation (#6669)

loadams committed 1 year ago

Verified 229960a5

Update profiler registration check (#6668)

loadams committed 1 year ago

Verified 54903e09

Add fallback for is_compiling (#6663)

tohtana committed 1 year ago

Verified 24285d6c

sequence parallel for uneven heads (#6392)

inkcherry committed 1 year ago

Verified 5fb71c0a

Newer Older