microsoft/DeepSpeed

Pull Requests Commits

Update HPU docker version

loadams committed 1 year ago

0ad1b857

Add hybrid_engine.py as path to trigger the DS-Chat GH workflow (#5562)

lekurile committed 1 year ago

Verified 3a3a6db3

Add Ulysses DistributedAttention compatibility (#5525)

Kwen-Chen committed 1 year ago

Verified f86824be

Add throughput timer configuration (#5363)

deepcharm committed 1 year ago

Verified 995ba119

[INF] DSAttention allow input_mask to have false as value (#5546)

oelayan7 committed 1 year ago

Verified f4efef21

Update to HF_HOME from TRANSFORMERS_CACHE (#4816)

loadams committed 1 year ago

Verified 263bfe28

Adapt doc for #4405 (#5552)

oraluben committed 1 year ago

Verified 29903925

Small typos in functions set_none_gradients_to_zero (#5557)

TravelLeraLone committed 1 year ago

Verified 975290ae

Avoid overwrite of compiled module wrapper attributes (#5549)

deepcharm committed 1 year ago

Verified 5b314f4e

Remove synchronize calls from allgather params (#5516)

BacharL committed 1 year ago

Verified 0a174038

Fix RuntimeError for moe on XPU: tensors found at least two devices (#5519)

shiyang-weng committed 1 year ago

Verified 695d79ea

Fix the TypeError for XPU Accelerator (#5531)

shiyang-weng committed 1 year ago

Verified 1d819673

CPUAdam fp16 and bf16 support (#5409)

BacharL committed 1 year ago

Verified 69af3611

Optimize zero3 fetch params using all_reduce (#5420)

deepcharm committed 1 year ago

Verified 49df8d8d

Rocm warp size fix (#5402)

rraminen committed 1 year ago

Verified 76c9c69f

rocblas -> hipblas changes for ROCm (#5401)

rraminen committed 1 year ago

Verified d3dd8e74

Skip the UT cases that use unimplemented op builders. (#5372)

foin6 committed 1 year ago

Verified 8e4f6e48

Enhance testing: Skip fused_optimizer tests if not supported. (#5159)

vshekhawat-hlab committed 1 year ago

Verified 7f55b20f

Improve _configure_optimizer() final optimizer log (#5528)

nelyahu committed 1 year ago

Verified 23173faa

New integration - CometMonitor (#5466)

alexkuzmik committed 1 year ago

Verified 488a823f

[manifest] update mainfest to add hpp file in deepspeed. (#5533)

ys950902 committed 1 year ago

Verified ebf82e8f

Switch from double quotes to match single quotes (#5530)

loadams committed 1 year ago

Verified 62ca3178

Switch pynvml to nvidia-ml-py (#5529)

loadams committed 1 year ago

Verified 82ce4ae8

enable phi2 autotp (#5436)

Yejing-Lai committed 1 year ago

Verified 3a7f3aa8

[manifest] update mainfest to add hpp file in csrc. (#5522)

ys950902 committed 1 year ago

Verified 4696afd2

Fused adam for HPU (#5500)

BacharL committed 1 year ago

Verified df4ef0ab

enable phi3_mini autotp (#5501)

Yejing-Lai committed 1 year ago

Verified 3dd7ccff

Fix compile wrapper (#5455)

BacharL committed 1 year ago

Verified 0b224edc

Fix crash when creating Torch tensor on NPU with device=get_accelerator().current_device() (#5464)

harygo2 committed 1 year ago

Verified 0fc19b6a

re-introduce: stage3: efficient compute of scaled_global_grad_norm (#5493)

nelyahu committed 1 year ago

Verified 90793aab

Older