microsoft/DeepSpeed

Pull Requests Commits

ShijieZZZZ committed 2 years ago

ddad3f5f

Merge remote-tracking branch 'remotes/origin/master' into remotes/origin/dev/tput

ShijieZZZZ committed 2 years ago

556e872f

ShijieZZZZ committed 2 years ago

58a2d520

report progress at gradient accumulation boundary

ShijieZZZZ committed 2 years ago

026f4453

Adding Gradient Accumulation Data Type Config (#2512)

jomayeri committed 2 years ago

Verified 21c28029

Pass down the new DS inference config to replace_transformer_layer. (#2539)

awan-10 committed 2 years ago

Verified 90ae6884

Change Where DS/Triton is Used in Stable Diffusion (#2536)

cmikeh2 committed 2 years ago

Verified 5df1eea7

Remove mutable default parameter in init_inference() (#2540)

aphedges committed 2 years ago

Verified 4abf637f

Add MII tests (#2533)

mrwyattii committed 2 years ago

Verified c5ee27f7

Make DS-Inference config readable from JSON (#2537)

mrwyattii committed 2 years ago

Verified 8b4318b9

Ensure is initialized for SD (#2534)

cmikeh2 committed 2 years ago

Verified 57e0a550

Fixes for torch 1.14 due to new torch.numel return type (#2522)

jeffra committed 2 years ago

Verified 21105521

Initial dequant library implementation (#2521)

cmikeh2 committed 2 years ago

Verified 30c8d8a8

Update codeowners (#2525)

jeffra committed 2 years ago

Verified 0b265326

Add note about nvcc/hipcc requirement (#2519)

jeffra committed 2 years ago

Verified 7ce371b1

Add missing Inference sub-configs (#2518)

mrwyattii committed 2 years ago

Verified fe678544

Fix backward compatibility for InferenceConfig (#2516)

mrwyattii committed 2 years ago

Verified e59f8054

Deepspeed quantization library v0.1 (#2450)

lokoppakmsft committed 2 years ago

Verified 78d4ca1f

Add max_tokens alias to max_out_tokens arg to maintain backwards compatibility (#2508)

lekurile committed 2 years ago

Verified d40a15fc

Update docs to autogenerate pydantic config model docs (#2509)

mrwyattii committed 2 years ago

Verified 43bf035c

DeepSpeed inference config. (#2459) (#2472)

awan-10 committed 2 years ago

Verified b5d18a6a

jeffra committed 2 years ago

a4ceabb6

Fix typos: deepseed -> deepspeed (#2499)

jinyouzhi committed 2 years ago

Verified 06e00f61

Make data contiguous before the inplace reshape-copy_ function (#2489)

lokoppakmsft committed 2 years ago

Verified f2710bbe

Fix nightly CI tests (#2493)

mrwyattii committed 2 years ago

Verified be5ec506

Make bf16_optimizer work for non pipeline (#2470)

tjruwase committed 2 years ago

Verified ee39187d

stage_1_and_2.py: no allreduce needed when mp size is 1 (#2494)

guoyejun committed 2 years ago

Verified 3ca9878d

Stable Diffusion Enhancements (#2491)

cmikeh2 committed 2 years ago

Verified e7e75955

Add `scale_attn_by_inverse_layer_idx` feature (#2486)

hyunwoongko committed 2 years ago

Verified 6f77da1b

[docs] add SD tutorial to deepspeed.ai news

jeffra committed 2 years ago

d2d1b4c3

Older