microsoft/DeepSpeed

Pull Requests Commits

Add megatron_v2 class variable to megatron policy

lekurile committed 3 years ago

8186da32

move _transpose() to base container

lekurile committed 3 years ago

5651f9e3

Update megatron container to work with MoE==1 text-generation example

lekurile committed 3 years ago

d190f68f

Fix MegatronLayerPolicy to have megatron_v2=True (#2579)

lekurile committed 3 years ago

Verified 731965db

Fix quantized-inference & Add generic support of checkpoint loading (#2547)

RezaYazdaniAminabadi committed 3 years ago

Verified 35b350b2

Drop Maxwell Support (#2574)

cmikeh2 committed 3 years ago

Verified b8416282

Support fp32 gradaccum for bf16 model (#2566)

delock committed 3 years ago

Verified 06938835

Add Determined to open-source DL frameworks (#2573)

sirredbeard committed 3 years ago

Verified 2d8f3f56

use get_global_rank if available (#2567)

jeffra committed 3 years ago

Verified d4cab2ce

docs: Update the recent url for Megatron-LM (#2564)

rapsealk committed 3 years ago

Verified bbe030c5

jeffra committed 3 years ago

c77d42dc

Fix invalid check of recorded parameter orders in zero stage3. (#2550)

inkcherry committed 3 years ago

Verified aeda7f9f

Abstract accelerator (step 1) (#2504)

delock committed 3 years ago

Verified ffcf3846

lekurile committed 3 years ago

9b24af91

Merge branch 'master' into inference-refactor-v1

lekurile committed 3 years ago

74233437

lekurile committed 3 years ago

09f37abb

Add ds_megatron_gpt model implementation + make explicit megatron is GPT specific

lekurile committed 3 years ago

9a36258d

Megatron container working w/ moe=1

lekurile committed 3 years ago

75003bed

add missing moe deprecated fields to inference config (#2556)

mrwyattii committed 3 years ago

Verified c5f85858

encoded ds config into command line argument when launching child processes in autotuning (#2524)

cli99 committed 3 years ago

Verified abe4fc6b

Report progress at gradient accumulation boundary (#2553)

ShijieZZZZ committed 3 years ago

Verified 340fc0cf

Container based OPT is working

lekurile committed 3 years ago

8ca77499

awan-10 committed 3 years ago

3f511079

Public inference v2 (#387)

awan-10 committed 3 years ago

Verified 102a1bdb

Adding Gradient Accumulation Data Type Config (#2512)

jomayeri committed 3 years ago

Verified 21c28029

Pass down the new DS inference config to replace_transformer_layer. (#2539)

awan-10 committed 3 years ago

Verified 90ae6884

Change Where DS/Triton is Used in Stable Diffusion (#2536)

cmikeh2 committed 3 years ago

Verified 5df1eea7

Remove mutable default parameter in init_inference() (#2540)

aphedges committed 3 years ago

Verified 4abf637f

Add MII tests (#2533)

mrwyattii committed 3 years ago

Verified c5ee27f7

Make DS-Inference config readable from JSON (#2537)

mrwyattii committed 3 years ago

Verified 8b4318b9

Newer Older