microsoft/DeepSpeed

Pull Requests Commits

Make data contiguous before the inplace reshape-copy_ function (#2489)

lokoppakmsft committed 3 years ago

Verified f2710bbe

Fix nightly CI tests (#2493)

mrwyattii committed 3 years ago

Verified be5ec506

Make bf16_optimizer work for non pipeline (#2470)

tjruwase committed 3 years ago

Verified ee39187d

stage_1_and_2.py: no allreduce needed when mp size is 1 (#2494)

guoyejun committed 3 years ago

Verified 3ca9878d

Revert parser_policies pre-commit formatting because it is terrible

molly-smith committed 3 years ago

7e833cfe

pre-commit checks

molly-smith committed 3 years ago

1c301f68

pre-commit formatting

molly-smith committed 3 years ago

5f929343

Stable Diffusion Enhancements (#2491)

cmikeh2 committed 3 years ago

Verified e7e75955

Assert parser policy exist for model

molly-smith committed 3 years ago

0e16e2ee

molly-smith committed 3 years ago

e9b7bcd5

Infer model name and policy map key from pipe.model

molly-smith committed 3 years ago

4788041e

Add `scale_attn_by_inverse_layer_idx` feature (#2486)

hyunwoongko committed 3 years ago

Verified 6f77da1b

[docs] add SD tutorial to deepspeed.ai news

jeffra committed 3 years ago

d2d1b4c3

[docs] add SD tutorial to news

jeffra committed 3 years ago

Verified a63cb07e

Fix CI issues related to cupy install (#2483)

mrwyattii committed 3 years ago

Verified 521d329b

molly-smith committed 3 years ago

d4702fc0

Modify engine with parser policy replace method (corrected)

molly-smith committed 3 years ago

6069c8ed

Revert "Modify engine with parser policy replace method"

molly-smith committed 3 years ago

a23a8cab

Modify engine with parser policy replace method

molly-smith committed 3 years ago

982a3c3b

Add correct memory-allocation at DeepSpeed-Attention (#2474)

RezaYazdaniAminabadi committed 3 years ago

Verified 9cfcf743

Merge branch 'master' into mosm/module_parser

molly-smith committed 3 years ago

e688dd79

fix accelerate link (#2481)

kyoto7250 committed 3 years ago

Verified a47c3e03

Added MLFLOW environment variables for logging metrics within trainig… (#2477)

savitamittal1 committed 3 years ago

Verified ffb6d987

Updating autotune json default in docs. (#2476)

jomayeri committed 3 years ago

Verified 4a06ecf6

don't gather partitioned activations for mp size 1 (#2454)

guoyejun committed 3 years ago

Verified f74ee318

Create a new folder structure to isolate model-specific code in DS (#2464)

awan-10 committed 3 years ago

Verified 35458da0

Add period in front of parentless linears

molly-smith committed 3 years ago

43650a67

fixing the checkpoint loading at inference-engine (#2429)

RezaYazdaniAminabadi committed 3 years ago

Verified 39bdc141

Cache Allocation and Softmax Fixes (#2433)

cmikeh2 committed 3 years ago

Verified 10e9d04c

Fixes for various CI problems (#2457)

mrwyattii committed 3 years ago

Verified 825f9d48

Newer Older