microsoft/DeepSpeed

Pull Requests Commits

cmikeh2 committed 2 years ago

7a5ccf66

cmikeh2 committed 2 years ago

5f08cda0

Linear layer bug fixes

cmikeh2 committed 2 years ago

e78ac173

cmikeh2 committed 2 years ago

ad5d427b

fix bad imports

jeffra committed 2 years ago

64f78219

Fix replace module matching name

cmikeh2 committed 2 years ago

318360ac

Additional SD changes

cmikeh2 committed 2 years ago

1d9b67e1

Add nhwc bias + builder

cmikeh2 committed 2 years ago

30858f96

Merge branch 'master' into cholmes/sd-extension

cmikeh2 committed 2 years ago

727ac474

Fix compiler warnings

cmikeh2 committed 2 years ago

447a4b06

Add layer norm implementation + unit tests

cmikeh2 committed 2 years ago

c4ef98d7

Create a new folder structure to isolate model-specific code in DS (#2464)

awan-10 committed 2 years ago

Verified 35458da0

fixing the checkpoint loading at inference-engine (#2429)

RezaYazdaniAminabadi committed 2 years ago

Verified 39bdc141

Cache Allocation and Softmax Fixes (#2433)

cmikeh2 committed 2 years ago

Verified 10e9d04c

Fixes for various CI problems (#2457)

mrwyattii committed 2 years ago

Verified 825f9d48

deepspeed/launcher/launch.py: add option '--enable_each_rank_log logdir' (#2409)

guoyejun committed 2 years ago

Verified 3432c740

Reduction Kernel Utility (#2436)

cmikeh2 committed 2 years ago

Verified be4ffb82

Fixing a mismatch in basic adam test. (#2447)

jomayeri committed 2 years ago

Verified 3b3ba3c2

Use CUDA events for inference model profiling (#2371)

mrwyattii committed 2 years ago

Verified e772f166

rollback ds config changes (#2395)

cli99 committed 2 years ago

Verified 8da0238b

Fix build issues on Windows (#2428)

eltonzheng committed 2 years ago

Verified b85eb3b9

update pytorch pool operator function signiture (#2443)

cli99 committed 2 years ago

Verified 5d1f595c

Fix Bug #2319 (#2438)

jomayeri committed 2 years ago

Verified 7d113633

jeffra committed 2 years ago

a5248643

Fix broken link to DeepSpeed Megatron fork (#2440)

lekurile committed 2 years ago

Verified 877a8818

parallelize writing of layer checkpoint files across data parallel instances (#1419)

adammoody committed 2 years ago

Verified b8fb9c3f

[memory estimators] new config args sync (#2431)

stas00 committed 2 years ago

Verified 99fde3b7

Add TestInjectionPolicy inference unittest class for testing custom injection policies (#2426)

lekurile committed 2 years ago

Verified b2a724e2

only add deps if extra is explictly called (#2432)

jeffra committed 2 years ago

Verified 1b7c6791

Universal checkpoint for zero stage 1 (#2284)

tjruwase committed 2 years ago

Verified 799120e7

Older