microsoft/DeepSpeed

Pull Requests Commits

TiledMLP + SequenceTiledCompute: improve the bs>1 use-case (#7422)

stas00 committed 166 days ago

Verified c2bb53f2

[Ulysses-ALST] add FA3 support (#7430)

stas00 committed 166 days ago

Verified d33b5623

set `device_id` in torch's `init_process_group` (#7266)

stas00 committed 166 days ago

Verified ee286e53

Use past_key_value when provided (#7428)

deepcharm committed 168 days ago

Verified 88ba24a3

fix: Propagate `strip_tensor_paddings` (#7426)

saforem2 committed 170 days ago

Verified a687d327

trying to fix nv-accelerate-v100.yml CI job (#7424)

stas00 committed 171 days ago

Verified affee605

Improvements to Communication Logger (#7404)

alexk101 committed 173 days ago

Verified f485e136

Align missing argument in AllReduceCoalescedHandle (#7414)

deepcharm committed 174 days ago

Verified ac16035d

[BUGFIX] Reset `bucket.elements` after reduction in ZeRO Stage 3 (#7418)

rahul713rk committed 175 days ago

Verified 27228462

Enable torch version dependent compilation of record_module and iter_params (#7362)

deepcharm committed 175 days ago

Verified 8ace4da7

Update version.txt after v0.17.2 release. (#7417)

loadams committed 175 days ago

Verified d6fe70ef

[TiledMLP]: fix for bs>1 (#7412)

stas00 committed 175 days ago

Verified 2790220d

fix: engine initializes optimizer attributes at the beginning (#7410)

HollowMan6 committed 176 days ago

Verified 15f054d9

fix: fix FileNotFoundError for build_win.bat (#7399)

gjj2828 committed 181 days ago

Verified da60a878

fix(comm): Expose GradBucket in deepspeed.comm API (#7400)

Flink-ddd committed 182 days ago

Verified e6324af9

fix: DeepCompile for torch 2.8 (#7402)

HollowMan6 committed 182 days ago

Verified 384e6d34

fix: Add `csrc/compile` to include paths for DeepCompile builder (#7401)

HollowMan6 committed 182 days ago

Verified a755a9e5

Added device detection to communication logging (#7398)

alexk101 committed 185 days ago

Verified 4c687bfd

Improve coverage of DeepCompile (#7386)

tohtana committed 185 days ago

Verified 6594c266

Fix ZeRO stage 1 and add stage 2 support with DeepCompile (#7366)

tohtana committed 185 days ago

Verified be8124c8

Fix unbound local error for `return_val` (#7395)

HollowMan6 committed 185 days ago

Verified 6c469425

add support for CUDAtk12.9 (#7394)

loscrossos committed 185 days ago

Verified 59bb08bf

fix broken url (#7390)

stas00 committed 186 days ago

Verified ebb64239

add blog link (#7385)

stas00 committed 188 days ago

Verified ec73d91b

fix(inference): Add missing dtype attribute to ParameterBase setter (#7378)

Flink-ddd committed 189 days ago

Verified 61829b55

Add support for ws=1 scenario (#7379)

NirSonnenschein committed 189 days ago

Verified 2a450b3a

Fix dtype mismatch in `TestParamPartitioningSkipInit` (#7377)

tohtana committed 189 days ago

Verified e049bbfa

fix wandb.log() call by removing `sync` kwarg (#7383)

ned2 committed 189 days ago

Verified 8dd21516

Fix release of IPG buffer (#7376)

tohtana committed 191 days ago

Verified d5f69151

Update latest news with DeepNVMe (#7375)

loadams committed 192 days ago

Verified 9606f8f0

Newer Older