microsoft/DeepSpeed

Pull Requests Commits

Update engine.py

jeffra committed 2 years ago

Verified 4214afa8

DS Benchmarks QoL Improvements (#2120)

Quentin-Anthony committed 2 years ago

Verified 8413b7f8

Bump tzinfo from 1.2.9 to 1.2.10 in /docs (#2126)

dependabot[bot] committed 2 years ago

Verified 6392f83d

Update moe doc (#2098)

awan-10 committed 2 years ago

Verified 86e13b8a

update info and links. (#2122)

awan-10 committed 2 years ago

Verified fb72ccdc

[docs] link fixes (#2124)

jeffra committed 2 years ago

Verified ed02d38d

[docs] website refresh (#2123)

jeffra committed 2 years ago

Verified a2506b54

fix issue in accelerate. (#2121)

Quentin-Anthony committed 2 years ago

Verified 9f5895cb

Checkpoint reshaping (#1953)

tjruwase committed 2 years ago

Verified 80d0a32f

DeepSpeed Compression announcement (#2114)

conglongli committed 2 years ago

Verified 46fffc0b

reduce ds-inference log verbosity (#2111)

jeffra committed 2 years ago

Verified 844d9f31

fix softmax dim of Residual MoE in moe/layer.py (#2110)

hero007feng committed 2 years ago

Verified b4513f63

Remove hardcoded ROCm install path (#2093)

mrwyattii committed 2 years ago

Verified 69b7c970

Adding DeepSpeed Compression Composer (#2105)

yaozhewei committed 2 years ago

Verified 0f4f2f98

jeffra committed 2 years ago

6b9df564

use HF NeoX (#2087)

mrwyattii committed 2 years ago

Verified ee7ea3b8

Dont overwrite hook handles in flop profiler (#2106)

Sanger2000 committed 2 years ago

Verified 9027f861

[ds-inference] checkpoint loading => tqdm (#2107)

stas00 committed 2 years ago

Verified 16699d83

Add Inference support for running the BigScience-BLOOM Architecture (#2083)

RezaYazdaniAminabadi committed 2 years ago

Verified aa88137b

jeffra committed 2 years ago

2feaf6d6

Improving memory utilization of Z2+MoE (#2079)

siddharth9820 committed 2 years ago

Verified c1af73f7

fixed "None type has no len()" (#2091)

xiazeyu committed 2 years ago

Verified b0523787

Add missing newline for ZeroOneAdam parameter table (#2088)

manuelciosici committed 2 years ago

Verified db3252b0

remove require grad in params count (#2065)

cli99 committed 2 years ago

Verified 0ad08608

Codeowner addendum and fix to small model debugging script (#2076)

samadejacobs committed 2 years ago

Verified 50a652e7

Fix partition id in the fp32->fp16 param copying step for z2+cpu-offload (#2059)

siddharth9820 committed 2 years ago

Verified b3388e14

Check for bf16 support only if CUDA is available (#2049)

aphedges committed 2 years ago

Verified 3540ce74

[docs] fix broken read-the-docs build (#2075)

jeffra committed 2 years ago

Verified 559fb8e5

Comments for better understanding of zero stage1_2 (#2027)

kisseternity committed 2 years ago

Verified 9305916d

add ds inference paper (#2072)

jeffra committed 2 years ago

Verified 9fc4e5f1

Older