microsoft/DeepSpeed

Pull Requests Commits

Validate warmup_type in WarmupCosineLR like WarmupLR (#8151)

sohumt123 committed 39 days ago

Verified 886790b5

Adopt PTF Code of Conduct (#8165)

sfc-gh-truwase committed 39 days ago

Verified 0c36f6d3

Z3: Support for activation ckpt with frozen params (#8148)

sfc-gh-truwase committed 39 days ago

Verified a31eb316

Fix repeated gradient scaling across pipeline stages (#8154)

Functionhx committed 41 days ago

Verified d99a6429

Fix ZeRO-3 hooks for attribute-delegating modules (#8144)

Functionhx committed 41 days ago

Verified 75f395fd

Update Zhipeng Wang affiliation to Google in COMMITTERS.md (#8153)

PKUWZP committed 44 days ago

Verified 4c275f9e

Update CI badge (#8150)

tohtana committed 44 days ago

Verified ec8411e6

Use synthetic CIFAR data in AlexNet tests (#8143)

tohtana committed 44 days ago

Verified b81c6eb3

Fix DeepCompile fallback handling for scalar outputs (#8149)

tohtana committed 45 days ago

Verified 397efe87

[DeepCompile] Add lightweight pass contracts for optimization passes (#8139)

jahnavi-yelamanchi committed 45 days ago

Verified b048a7dc

fix(muon): support ZeRO-1/2 reduce scatter (#8141)

Micuks committed 45 days ago

Verified de1846cf

fix(exceptions): narrow broad Exception clauses to specific types (#8136)

sowndappan5 committed 45 days ago

Verified 9102e8ed

Fix DeepSpeedInferenceConfig crash on bool moe backward-compat value (#8145)

winklemad committed 45 days ago

Verified 17e19b19

Reduce blockDim in fake_quantize_kernel for improved SM occupancy (#8115)

flutist committed 46 days ago

Verified 000ca191

fix(autotp): when using autotp, ignore the consistency of certain data within the tp_group. (#8125)

1787648106 committed 46 days ago

Verified 53a2ac44

Add EXAONE 4.5 model support for Inference V2 (#8121)

Bias92 committed 47 days ago

Verified d36079f9

Guard WarmupCosineLR against total_num_steps == warmup_num_steps (ZeroDivisionError) (#8142)

vineethsaivs committed 47 days ago

Verified 2163a013

Fix CommsLogger.stop_profiling_comms not disabling global profiling (#8137)

vineethsaivs committed 47 days ago

Verified 10db6919

ZeRO 1/2: wait on all IPG-bucket producer streams in average_tensor (#8061) (#8080)

arunshar committed 48 days ago

Verified 711bd11e

Make DCO workflow Probot compatible (#8110)

tohtana committed 49 days ago

Verified 46c9e20f

Add AutoEP + AutoTP parallel folding (#8064)

tohtana committed 49 days ago

Verified 104193b4

Add Hybrid Engine rollout in DeepSpeed to support On-Policy Distillation (OPSD) Trainer (#8027)

PKUWZP committed 50 days ago

Verified 429e2ad2

feat(types): add type hints to public comm API functions (#8118)

NovusEdge committed 50 days ago

Verified 9b106c49

doc: Remove suggestion to build extensions in parallel (#7899)

Flamefire committed 50 days ago

Verified 05a481b8

Fix ZeRO-3 autocast gather with mixed parameter dtypes (#8113)

tohtana committed 50 days ago

Verified 195255e7

Fix ZeRO-3: use per-param dtype for quantize-scale buffer in _allgather_params_coalesced (#8128)

roycho96 committed 51 days ago

Verified b079c309

Add input validation for save_checkpoint and warmup LR schedulers (#8126)

jahnavi-yelamanchi committed 52 days ago

Verified 54ebdec6

Fix Python 3.9 import-time TypeError in AutoEP ep_router (#8119)

vineethsaivs committed 54 days ago

Verified ae1dba54

Fix FlopsProfiler crash when dp_world_size is None under sequence parallelism (#8122)

vineethsaivs committed 55 days ago

Verified 6e38d56f

fix: add buffer-length check in shm.cpp (#8082)

orbisai0security committed 55 days ago

Verified 7720656e

Newer Older