microsoft/DeepSpeed

Pull Requests Commits

deepspeed/launcher/launch.py: add option '--enable_each_rank_log logdir' (#2409)

guoyejun committed 3 years ago

Verified 3432c740

Include all nn.modulelist modules in injection policy

molly-smith committed 3 years ago

23497c5b

Reduction Kernel Utility (#2436)

cmikeh2 committed 3 years ago

Verified be4ffb82

Fixing a mismatch in basic adam test. (#2447)

jomayeri committed 3 years ago

Verified 3b3ba3c2

Use CUDA events for inference model profiling (#2371)

mrwyattii committed 3 years ago

Verified e772f166

rollback ds config changes (#2395)

cli99 committed 3 years ago

Verified 8da0238b

Update test_module_parser.sh to loop through all modeling_*.py files

molly-smith committed 3 years ago

8cac4823

Infer module by nn.modulelist

molly-smith committed 3 years ago

bc4960e1

Fix build issues on Windows (#2428)

eltonzheng committed 3 years ago

Verified b85eb3b9

generate dicts with model name

molly-smith committed 3 years ago

b9563b49

Add other scripts for testing module_parser

molly-smith committed 3 years ago

81771bb0

update pytorch pool operator function signiture (#2443)

cli99 committed 3 years ago

Verified 5d1f595c

Handle no parent name case. Create output file.

molly-smith committed 3 years ago

b2320800

Fix Bug #2319 (#2438)

jomayeri committed 3 years ago

Verified 7d113633

Regex for stack level. Check all regex expressions and linear layer instances at all levels

molly-smith committed 3 years ago

b7381b3b

jeffra committed 3 years ago

a5248643

Fix broken link to DeepSpeed Megatron fork (#2440)

lekurile committed 3 years ago

Verified 877a8818

parallelize writing of layer checkpoint files across data parallel instances (#1419)

adammoody committed 3 years ago

Verified b8fb9c3f

Cleanup and comments

molly-smith committed 3 years ago

8d5dc074

Filter linear layers by layer norm

molly-smith committed 3 years ago

44553ae6

[memory estimators] new config args sync (#2431)

stas00 committed 3 years ago

Verified 99fde3b7

Gems only have one parent name. Remove extra quotes from injection policy print

molly-smith committed 3 years ago

1e6e4c37

Add TestInjectionPolicy inference unittest class for testing custom injection policies (#2426)

lekurile committed 3 years ago

Verified b2a724e2

only add deps if extra is explictly called (#2432)

jeffra committed 3 years ago

Verified 1b7c6791

Universal checkpoint for zero stage 1 (#2284)

tjruwase committed 3 years ago

Verified 799120e7

Fixing bug 2361 (#2410)

jomayeri committed 3 years ago

Verified 906b4a02

Fix for inference gpt-j test (#2430)

mrwyattii committed 3 years ago

Verified 34fb6d19

fixes #2389 (#2411)

Alexander Jipa committed 3 years ago

Verified cfead551

Make error regex more generic in collect_results.py (#2415)

molly-smith committed 3 years ago

Verified 5eafb8c7

fix checkpoint loading when it is a dictionary (#2425)

RezaYazdaniAminabadi committed 3 years ago

Verified 537e8581

Newer Older