microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into cpu-adam/optional_CUDA-copy

RezaYazdaniAminabadi committed 4 years ago

Verified 04d76d59

guard for when cuda is not available & test with cpu-only environment

Reza Yazdani committed 4 years ago

8950731e

[actions] add master to formatting trigger

jeffra committed 4 years ago

Verified 86b948f9

[actions] update branch triggers

jeffra committed 4 years ago

Verified 8f299be5

[actions] split formatting and unit tests into two jobs (#1339)

jeffra committed 4 years ago

Verified 600db091

Update main.yml (#1338)

jeffra committed 4 years ago

Verified 74f058b9

Use mpu in zero.Init() (#1325)

tjruwase committed 4 years ago

Verified e08c239c

Support client lr schedulers that are not subclass of torch _LRScheduler (#1337)

tjruwase committed 4 years ago

Verified 8e301b6e

Added drop_last to DeepSpeedDataLoader (#1321)

hxri committed 4 years ago

Verified c0b27fb0

Remove duplicate clip grad function in deepspeed (#1333)

awan-10 committed 4 years ago

Verified ddffbae0

return true when there is no mismatch on the cuda version

Reza Yazdani committed 4 years ago

ee35deb7

update for cuda-11.4 (#1329)

stas00 committed 4 years ago

Verified b9ece257

Use clone to avoid checkpoint bloat (#1326)

tjruwase committed 4 years ago

Verified 336dd089

Activation checkpointing improvements (#1254)

tjruwase committed 4 years ago

Verified 85acf14c

Merge branch 'master' into cpu-adam/optional_CUDA-copy

RezaYazdaniAminabadi committed 4 years ago

Verified 52f7f7bc

Reza Yazdani committed 4 years ago

71a4d3d4

fixing the builder issues

Reza Yazdani committed 4 years ago

6eda1447

use scalar cpu-adam in case of exception in builder (#1259)

RezaYazdaniAminabadi committed 4 years ago

Verified 9645e7bc

Add more synchronizations and barriers for the multi-gpu inference case (#1309)

RezaYazdaniAminabadi committed 4 years ago

Verified 0ec11daa

jeffra committed 4 years ago

c1b0a4e1

Merge branch 'master' into cpu-adam/optional_CUDA-copy

RezaYazdaniAminabadi committed 4 years ago

Verified 8ce051cf

Reducing the memory-overhead of creating model for multi-GPU run (#1244)

RezaYazdaniAminabadi committed 4 years ago

Verified 49b6a632

Support Callable type for client optimizer and lr_scheduler (#1316)

tjruwase committed 4 years ago

Verified 274c375c

[zero] restore fp16 params if no zero ckpts available (#1322)

jeffra committed 4 years ago

Verified aa121291

remove CUDA dependency from op_builder when building against CPU

Reza Yazdani committed 4 years ago

2d8b7df4

Merge branch 'master' into cpu-adam/optional_CUDA-copy

RezaYazdaniAminabadi committed 4 years ago

Verified 248bb35c

Add issue templates

jeffra committed 4 years ago

10b48405

[docs] update moe features and news post

jeffra committed 4 years ago

6cd5f87b

add MoE press release links

jeffra committed 4 years ago

058ab819

Updating the torch version check to numeric (#1314)

pruthvistony committed 4 years ago

Verified e804f150

Older