microsoft/DeepSpeed

Pull Requests Commits

fixing formatting issues

duli2012 committed 3 years ago

b0b4963d

Fixing a few bugs.

duli2012 committed 3 years ago

b7d20506

Add async schedule.

duli2012 committed 3 years ago

133ad14b

add mem_offload unit test cases

eltonzheng committed 3 years ago

c65c425f

add memory offload

eltonzheng committed 3 years ago

bb1e6236

jeffra committed 3 years ago

ef5e0854

Adding pickle free communication.

duli2012 committed 3 years ago

0b3488a0

Improve ds_report output for HIP/ROCm (#1906)

mrwyattii committed 3 years ago

Verified 8cc8c003

Fix multiple zero 3 tracing errors (#1901)

tjruwase committed 3 years ago

Verified ef17c895

Use cuda events to improve timing for multi-stream execution (#1881)

tjruwase committed 3 years ago

Verified fee73135

cast bool when not supported by torch2cupy (#1894)

conglongli committed 3 years ago

Verified 66aae13d

[partition_parameters.py] better diagnostics (#1887)

stas00 committed 3 years ago

Verified fb00e6a1

Use f-strings where possible (#1900)

manuelciosici committed 3 years ago

Verified 3b5b92cb

fix file ordering (#1822)

szhengac committed 3 years ago

Verified 801c1723

bf16+pipeline parallelism (#1801)

tjruwase committed 3 years ago

Verified 56c52238

[docs] fix commonmarker security issue (#1892)

jeffra committed 3 years ago

Verified 9bf1e9af

Bump nokogiri from 1.13.3 to 1.13.4 in /docs (#1889)

dependabot[bot] committed 3 years ago

Verified ea9c0575

remove the print line in _einsum_flops_compute function (#1885)

VisionTheta committed 3 years ago

Verified d8ed3ce4

add now required `-lcurand` to solve `undefined symbol: curandCreateGenerator` (#1879)

stas00 committed 3 years ago

Verified c4873722

[docs] fix dead links (#1877)

jeffra committed 3 years ago

Verified 0149bd4f

Supporting multiple modules injection with a single policy when they have identical architectures (#1869)

samyam committed 3 years ago

Verified c13457b7

[docs] add moe paper (#1875)

jeffra committed 3 years ago

Verified 4a356d08

[docs] add amd blog to website (#1874)

jeffra committed 3 years ago

Verified b9e15296

Fix broken links (#1873)

tjruwase committed 3 years ago

Verified d6db6510

Add support for AWS SageMaker. (#1868)

matherit committed 3 years ago

Verified b47e25bf

Fix setup.py crash when torch is not installed. (#1866)

PaperclipBadger committed 3 years ago

Verified 73b5d983

jeffra committed 3 years ago

398f0603

qkv_out can be a single tensor or a list. Handling these cases separetely. (#1850)

samyam committed 3 years ago

Verified ebbcfd52

Import ABC from collections.abc for Python 3.10 compatibility. (#1851)

tirkarthi committed 3 years ago

Verified c7af747c

fix dead MoQ link (#1855)

jeffra committed 3 years ago

Verified 208d45bb

Older