microsoft/DeepSpeed

Pull Requests Commits

Quentin-Anthony committed 3 years ago

fabe35fb

Add more group logic to NCCL backend

Quentin-Anthony committed 3 years ago

a95922f3

update group benchmarks and add groups to nccl backend

Quentin-Anthony committed 3 years ago

96f79359

Make benchmarks sync, add async_op to all ops

Quentin-Anthony committed 3 years ago

67b75979

working multi-pg prototype

Quentin-Anthony committed 3 years ago

c31d72ee

Add blocking arg and prototype n-pg

Quentin-Anthony committed 3 years ago

ff053852

Add some missing files

Quentin-Anthony committed 3 years ago

5af66260

Add prototype nccl/mpi backends

Quentin-Anthony committed 3 years ago

a4c7be9d

Added wip nccl files

Quentin-Anthony committed 3 years ago

9790e322

[CI] force upgrade HF dependencies & output py env (#2015)

jeffra committed 3 years ago

Verified e6f444ae

update CODEOWNERS (#2017)

conglongli committed 3 years ago

Verified 117c9cdf

Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO-1 (#2007)

Quentin-Anthony committed 3 years ago

Verified 25b2fc29

DeepSpeed comm backend v1 (#1985)

awan-10 committed 3 years ago

Verified 36ad3119

[docs] add new build badges to landing page (#1998)

jeffra committed 3 years ago

Verified 828ab718

Propagate max errorcode to deepspeed when using PDSH launcher (#1994)

jerrymannil committed 3 years ago

Verified d0eae5ad

[bug] Add user-defined launcher args for MPI launcher (#1933)

mrwyattii committed 3 years ago

Verified 3678ee17

Add torch-latest and torch-nightly CI workflows (#1990)

mrwyattii committed 3 years ago

Verified 7fc30650

fix typo when getting kernel dim in conv calculation (#1989)

cli99 committed 3 years ago

Verified 6719b46b

added temp fix for our CI jobs (#1988)

mrwyattii committed 3 years ago

Verified b6f2a560

Add unit test for various model families and inference tasks (#1981)

mrwyattii committed 3 years ago

Verified 5d3c6718

small fix for the HF Bert models (#1984)

RezaYazdaniAminabadi committed 3 years ago

Verified 0ebd81df

add 530b paper (#1979)

jeffra committed 3 years ago

Verified 3da84185

jeffra committed 3 years ago

eb2ec7f4

Fixing several bugs in the inference-api and the kernels (#1951)

RezaYazdaniAminabadi committed 3 years ago

Verified 8164ea9e

Fix: Sparse tensors not updating (#1914)

Dipet committed 3 years ago

Verified b8ff4825

Add Unidirectional Sparse Attention Type to BigBird and BSLongformer (#1959)

Quentin-Anthony committed 3 years ago

Verified 5208eb73

Update cpu_adam.py (#1968)

jeffra committed 3 years ago

Verified 737fee63

Update Gemfile.lock (#1966)

jeffra committed 3 years ago

Verified 79249428

Fix timer typo (#1964)

Quentin-Anthony committed 3 years ago

Verified 0d368932

Bump nokogiri from 1.13.4 to 1.13.6 in /docs (#1965)

dependabot[bot] committed 3 years ago

Verified e329e985

Older