microsoft/DeepSpeed

Pull Requests Commits

Make bf16_optimizer work for non pipeline (#2470)

tjruwase committed 2 years ago

Verified ee39187d

stage_1_and_2.py: no allreduce needed when mp size is 1 (#2494)

guoyejun committed 2 years ago

Verified 3ca9878d

Stable Diffusion Enhancements (#2491)

cmikeh2 committed 2 years ago

Verified e7e75955

Add `scale_attn_by_inverse_layer_idx` feature (#2486)

hyunwoongko committed 2 years ago

Verified 6f77da1b

[docs] add SD tutorial to deepspeed.ai news

jeffra committed 2 years ago

d2d1b4c3

[docs] add SD tutorial to news

jeffra committed 2 years ago

Verified a63cb07e

Fix CI issues related to cupy install (#2483)

mrwyattii committed 2 years ago

Verified 521d329b

Add correct memory-allocation at DeepSpeed-Attention (#2474)

RezaYazdaniAminabadi committed 2 years ago

Verified 9cfcf743

fix accelerate link (#2481)

kyoto7250 committed 2 years ago

Verified a47c3e03

Added MLFLOW environment variables for logging metrics within trainig… (#2477)

savitamittal1 committed 2 years ago

Verified ffb6d987

Updating autotune json default in docs. (#2476)

jomayeri committed 2 years ago

Verified 4a06ecf6

don't gather partitioned activations for mp size 1 (#2454)

guoyejun committed 2 years ago

Verified f74ee318

Create a new folder structure to isolate model-specific code in DS (#2464)

awan-10 committed 2 years ago

Verified 35458da0

fixing the checkpoint loading at inference-engine (#2429)

RezaYazdaniAminabadi committed 2 years ago

Verified 39bdc141

Cache Allocation and Softmax Fixes (#2433)

cmikeh2 committed 2 years ago

Verified 10e9d04c

Fixes for various CI problems (#2457)

mrwyattii committed 2 years ago

Verified 825f9d48

deepspeed/launcher/launch.py: add option '--enable_each_rank_log logdir' (#2409)

guoyejun committed 2 years ago

Verified 3432c740

Reduction Kernel Utility (#2436)

cmikeh2 committed 2 years ago

Verified be4ffb82

Fixing a mismatch in basic adam test. (#2447)

jomayeri committed 2 years ago

Verified 3b3ba3c2

Use CUDA events for inference model profiling (#2371)

mrwyattii committed 2 years ago

Verified e772f166

rollback ds config changes (#2395)

cli99 committed 2 years ago

Verified 8da0238b

Fix build issues on Windows (#2428)

eltonzheng committed 2 years ago

Verified b85eb3b9

update pytorch pool operator function signiture (#2443)

cli99 committed 2 years ago

Verified 5d1f595c

Fix Bug #2319 (#2438)

jomayeri committed 2 years ago

Verified 7d113633

jeffra committed 2 years ago

a5248643

Fix broken link to DeepSpeed Megatron fork (#2440)

lekurile committed 2 years ago

Verified 877a8818

parallelize writing of layer checkpoint files across data parallel instances (#1419)

adammoody committed 2 years ago

Verified b8fb9c3f

[memory estimators] new config args sync (#2431)

stas00 committed 2 years ago

Verified 99fde3b7

Add TestInjectionPolicy inference unittest class for testing custom injection policies (#2426)

lekurile committed 2 years ago

Verified b2a724e2

only add deps if extra is explictly called (#2432)

jeffra committed 2 years ago

Verified 1b7c6791

Newer Older