deepspeedai/DeepSpeed

Pull Requests Commits

fixes for ckpt tests, still need to rebase though

jeffra committed 4 years ago

613fdf09

import version fix

jeffra committed 4 years ago

387e8e0f

version import fix

jeffra committed 4 years ago

e1bbe55d

add missing legacy config to zero defaults

jeffra committed 4 years ago

5d0249bb

jeffra committed 4 years ago

eb22bc42

jeffra committed 4 years ago

51f46b11

add legacy stage1 mode + cleanup

jeffra committed 4 years ago

1a1966e1

add zero-1 mode to zero-2 codebase

jeffra committed 4 years ago

a09cfc68

[tests] make it easier to run tests (#923)

stas00 committed 4 years ago

Verified de694b91

Relax dataset type check in deepspeed io (#1012)

cli99 committed 4 years ago

Verified c5700bc0

improve assert message (#1024)

stas00 committed 4 years ago

Verified c4485e2f

[fp32] fix default dtype (#1023)

stas00 committed 4 years ago

Verified 18a26e86

Handle Norm allreduce when no mp (#1021)

tjruwase committed 4 years ago

Verified 429dfa6c

Samyamr/full precision for ZeRO Stage2 and Stage3 (#1004)

samyam committed 4 years ago

Verified dad26428

Transformer - fix unit test (#964)

RezaYazdaniAminabadi committed 4 years ago

Verified cab30aa6

[zero_to_fp32.py] support param groups (#1017)

stas00 committed 4 years ago

Verified a8cf887d

Refactor param_dict to config (#1008)

Sean Naren committed 4 years ago

Verified 41ab660b

add ds integrations (#963)

cli99 committed 4 years ago

Verified 14a50c68

fix gradient_clipping default (#656)

stas00 committed 4 years ago

Verified b7f97061

Add find_unused_parameters option to DeepSpeedEngine (#945)

ghosthamlet committed 4 years ago

Verified d0b61f18

Minor usability tweaks/fixes (#1001)

tjruwase committed 4 years ago

Verified 03d24fe0

Use amp autocast in ZeRO3 linear (#990)

tjruwase committed 4 years ago

Verified e88ebbcf

Asynchronous I/O docs (#1000)

tjruwase committed 4 years ago

Verified bff4bc72

[doc] add missing pin_memory entry (#999)

stas00 committed 4 years ago

Verified ecf2e1bc

Fix issue where gradient_predivide_factor was called as a func. (#996)

wbuchwalter committed 4 years ago

Verified a7118789

Add nvme unit/perf tests (#993)

tjruwase committed 4 years ago

Verified cf5ea891

Fix all Pipeline Module Parameters being sent to cuda:0 (#687)

sdtblck committed 4 years ago

Verified 669028f0

Make reduce scatter optional for ZeRO-1 as workaround (#971)

tjruwase committed 4 years ago

Verified 0b80ad06

Use odd shape tensor to represent parameter data in partitioned state (#981)

cli99 committed 4 years ago

Verified 894f21da

1-bit LAMB optimizer (#970)

conglongli committed 4 years ago

Verified 67a48aaa

Older