deepspeedai/DeepSpeed

Pull Requests Commits

Use past_key_value when provided (#7428)

deepcharm committed 1 year ago

Verified 88ba24a3

fix: Propagate `strip_tensor_paddings` (#7426)

saforem2 committed 1 year ago

Verified a687d327

Merge branch 'master' into zhipwang_dev

sfc-gh-truwase committed 1 year ago

Verified 7e907a25

trying to fix nv-accelerate-v100.yml CI job (#7424)

stas00 committed 1 year ago

Verified affee605

Improvements to Communication Logger (#7404)

alexk101 committed 1 year ago

Verified f485e136

Align missing argument in AllReduceCoalescedHandle (#7414)

deepcharm committed 1 year ago

Verified ac16035d

[BUGFIX] Reset `bucket.elements` after reduction in ZeRO Stage 3 (#7418)

rahul713rk committed 1 year ago

Verified 27228462

Enable torch version dependent compilation of record_module and iter_params (#7362)

deepcharm committed 1 year ago

Verified 8ace4da7

Update version.txt after v0.17.2 release. (#7417)

loadams committed 1 year ago

Verified d6fe70ef

[TiledMLP]: fix for bs>1 (#7412)

stas00 committed 1 year ago

Verified 2790220d

fix: engine initializes optimizer attributes at the beginning (#7410)

HollowMan6 committed 1 year ago

Verified 15f054d9

fix: fix FileNotFoundError for build_win.bat (#7399)

gjj2828 committed 1 year ago

Verified da60a878

fix(comm): Expose GradBucket in deepspeed.comm API (#7400)

Flink-ddd committed 1 year ago

Verified e6324af9

fix: DeepCompile for torch 2.8 (#7402)

HollowMan6 committed 1 year ago

Verified 384e6d34

fix: Add `csrc/compile` to include paths for DeepCompile builder (#7401)

HollowMan6 committed 1 year ago

Verified a755a9e5

Added device detection to communication logging (#7398)

alexk101 committed 1 year ago

Verified 4c687bfd

Improve coverage of DeepCompile (#7386)

tohtana committed 1 year ago

Verified 6594c266

Fix ZeRO stage 1 and add stage 2 support with DeepCompile (#7366)

tohtana committed 1 year ago

Verified be8124c8

Fix unbound local error for `return_val` (#7395)

HollowMan6 committed 1 year ago

Verified 6c469425

add support for CUDAtk12.9 (#7394)

loscrossos committed 1 year ago

Verified 59bb08bf

fix broken url (#7390)

stas00 committed 1 year ago

Verified ebb64239

add blog link (#7385)

stas00 committed 1 year ago

Verified ec73d91b

fix(inference): Add missing dtype attribute to ParameterBase setter (#7378)

Flink-ddd committed 1 year ago

Verified 61829b55

Add support for ws=1 scenario (#7379)

NirSonnenschein committed 1 year ago

Verified 2a450b3a

Fix dtype mismatch in `TestParamPartitioningSkipInit` (#7377)

tohtana committed 1 year ago

Verified e049bbfa

fix wandb.log() call by removing `sync` kwarg (#7383)

ned2 committed 1 year ago

Verified 8dd21516

Fix release of IPG buffer (#7376)

tohtana committed 1 year ago

Verified d5f69151

Update latest news with DeepNVMe (#7375)

loadams committed 1 year ago

Verified 9606f8f0

Relax tolerances for FP8 unit test only for ROCm + FP16 (#7373)

rraminen committed 1 year ago

Verified d33baf00

Flops profiler support for F.interpolate (#7353)

sfc-gh-truwase committed 1 year ago

Verified 25da6fc1

Newer Older