microsoft/DeepSpeed

Pull Requests Commits

CPUAdam fp16 and bf16 support (#5409)

Liran Bachar committed 2 years ago

Verified 69af3611

Optimize zero3 fetch params using all_reduce (#5420)

deepcharm committed 2 years ago

Verified 49df8d8d

Rocm warp size fix (#5402)

rraminen committed 2 years ago

Verified 76c9c69f

rocblas -> hipblas changes for ROCm (#5401)

rraminen committed 2 years ago

Verified d3dd8e74

Skip the UT cases that use unimplemented op builders. (#5372)

foin6 committed 2 years ago

Verified 8e4f6e48

Enhance testing: Skip fused_optimizer tests if not supported. (#5159)

vshekhawat-hlab committed 2 years ago

Verified 7f55b20f

Improve _configure_optimizer() final optimizer log (#5528)

nelyahu committed 2 years ago

Verified 23173faa

New integration - CometMonitor (#5466)

alexkuzmik committed 2 years ago

Verified 488a823f

[manifest] update mainfest to add hpp file in deepspeed. (#5533)

ys950902 committed 2 years ago

Verified ebf82e8f

Switch from double quotes to match single quotes (#5530)

loadams committed 2 years ago

Verified 62ca3178

Switch pynvml to nvidia-ml-py (#5529)

loadams committed 2 years ago

Verified 82ce4ae8

enable phi2 autotp (#5436)

Yejing-Lai committed 2 years ago

Verified 3a7f3aa8

[manifest] update mainfest to add hpp file in csrc. (#5522)

ys950902 committed 2 years ago

Verified 4696afd2

Fused adam for HPU (#5500)

BacharL committed 2 years ago

Verified df4ef0ab

enable phi3_mini autotp (#5501)

Yejing-Lai committed 2 years ago

Verified 3dd7ccff

Fix compile wrapper (#5455)

BacharL committed 2 years ago

Verified 0b224edc

Fix crash when creating Torch tensor on NPU with device=get_accelerator().current_device() (#5464)

harygo2 committed 2 years ago

Verified 0fc19b6a

re-introduce: stage3: efficient compute of scaled_global_grad_norm (#5493)

nelyahu committed 2 years ago

Verified 90793aab

Un-pin torch version in nv-torch-latest back to latest and skip test_compile_zero tests on v100 (#5459)

loadams committed 2 years ago

Verified f32ad3e1

fix: swapping order of parameters in create_dir_symlink method. (#5465)

alvieirajr committed 2 years ago

Verified 059bb208

Update with ops not supported on Windows (#5468)

loadams committed 2 years ago

Verified 4c15ad9f

Update ds-chat CI workflow paths to include zero stage 1-3 files (#5462)

lekurile committed 2 years ago

Verified e37296b2

Revert "stage3: efficient compute of scaled_global_grad_norm (#5256)" (#5461)

lekurile committed 2 years ago

Verified bc48371c

Fix torch.compile error for PyTorch v2.3 (#5463)

tohtana committed 2 years ago

Verified fcc731f0

Add getter and setter methods for compile_backend across accelerators. (#5299)

vshekhawat-hlab committed 2 years ago

Verified fa8458b1

Update version.txt after 0.14.2 release (#5458)

mrwyattii committed 2 years ago

Verified fbdf0eaf

Update PyTest torch version to match PyTorch latest official (2.3.0) (#5454)

loadams committed 2 years ago

Verified 5f631abc

Update README.md (#5453)

Jhonso7393 committed 2 years ago

Verified ad202795

OptimizedLinear implementation (#5355)

jeffra committed 2 years ago

Verified 5e6c9b93

set the default to use set_to_none for clearing gradients in BF16 optimizer. (#5434)

inkcherry committed 2 years ago

Verified c66bc426

Newer Older