microsoft/DeepSpeed

Pull Requests Commits

Enable workflow_dispatch for transformers workflow

loadams committed 1 year ago

641f9e58

Fix for stage3 when setting different communication data type (#4540)

BacharL committed 1 year ago

Verified b1868169

[NPU] Add HcclBackend for 1-bit adam, 1-bit lamb, 0/1 adam (#4733)

RUAN-ZX committed 1 year ago

Verified 2ce6bf8c

improve the way to determine whether a variable is None (#4782)

RUAN-ZX committed 1 year ago

Verified 7b818ee9

[BUG] partition_balanced return wrong result. (#4312)

zjjMaiMai committed 1 year ago

Verified 2bdf061f

BF16_Optimizer: add support for bf16 grad acc (#4713)

nelyahu committed 1 year ago

Verified ce607080

fix autoTP issue for mpt (trust_remote_code=True) (#4787)

sywangyi committed 1 year ago

Verified 29f840fd

Fix Hybrid Engine metrics printing (#4789)

lekurile committed 1 year ago

Verified 5f41bd06

Run workflows when they are edited (#4779)

loadams committed 1 year ago

Verified 93a81b53

Update dockerfile with updated versions (#4780)

loadams committed 1 year ago

Verified 15ed83a9

Resolve any '..' in the file paths using os.path.abspath() (#4709)

rraminen committed 1 year ago

Verified 9dfb06de

Fix DS Stable Diffusion for latest diffusers version (#4770)

lekurile committed 1 year ago

Verified f57fc4c9

bump version to 0.12.5

mrwyattii committed 1 year ago

Verified 4997b0fd

Add safetensors support (#4659)

Jih-neng Lin committed 1 year ago

Verified 7122362f

fix: to solve #4726 (#4727)

RUAN-ZX committed 1 year ago

Verified 02288bc1

Fix logger formatting for partitioning flags (#4728)

OAfzal committed 1 year ago

Verified 8640b8e5

fix mics run with offload++ (#4749)

GuanhuaWang committed 1 year ago

Verified ba6bfd0b

Re-organize `.gitignore` file to be parsed properly (#4740)

aphedges committed 1 year ago

Verified 3418b869

Add nv-sd badge to README (#4747)

loadams committed 1 year ago

Verified 8db9379f

Install `deepspeed-kernels` only on Linux (#4739)

aphedges committed 1 year ago

Verified 969b8cf5

use all_gather_into_tensor instead of all_gather (#4705)

taozhiwei committed 1 year ago

Verified fd0a52c1

[docs] Intel inference blog (#4734)

jeffra committed 1 year ago

Verified 6b8103b4

Communication Optimization for Large-Scale Training (#4695)

RezaYazdaniAminabadi committed 1 year ago

Verified 2afa1c7f

Update flops profiler to recurse (#4374)

loadams committed 1 year ago

Verified 61391229

Remove unneeded dict reinit (fix for #4565) (#4702)

eisene committed 1 year ago

Verified a603a213

Add get and set APIs for the ZeRO-3 partitioned parameters (#4681)

yiliu30 committed 1 year ago

Verified 0ec2d3e4

infV2 fix for OPT size variants (#4694)

mrwyattii committed 1 year ago

Verified a3926bbb

[Bug fix] WarmupCosineLR issues (#4688)

sbwww committed 1 year ago

Verified ce0ebdad

Add new MII unit tests (#4693)

mrwyattii committed 1 year ago

Verified bcdabf44

fixes issues introduced in #4668

jeffra committed 1 year ago

5acef9e1

Older