deepspeedai/DeepSpeed

Pull Requests Commits

Print more tensors. Add torch syncs to attn.

molly-smith committed 2 years ago

1aed330c

Remove unnecessary mlp baseline preprocessing

lekurile committed 2 years ago

9c13a1d0

complete attn baseline

molly-smith committed 2 years ago

29415d08

lekurile committed 2 years ago

9461d65d

Merge branch 'debug-ds-inf' of github.com:microsoft/DeepSpeed into debug-ds-inf

awan-10 committed 2 years ago

f746e9df

reorder code to cleanup/merge base_mlp in one place.

awan-10 committed 2 years ago

e245219f

Typo Correction (#3621)

Micah Zoltu committed 2 years ago

Verified e02b8d0b

Update megatron.md (#3641)

wjessup committed 2 years ago

Verified 8f459c50

Skip tests on docs-only changes (#3651)

mrwyattii committed 2 years ago

Verified 8b8c7031

Add Ascend NPU accelerator support (#3595)

CurryRice233 committed 2 years ago

Verified f3c8eaca

Add attention baseline

molly-smith committed 2 years ago

548a3966

stage3.py: do not scale if gradient_predivide_factor is 1.0 (#3630)

guoyejun committed 2 years ago

Verified 52907a66

AISC launcher fixes (#3637)

jeffra committed 2 years ago

Verified 49a73549

Align InferenceEngine to store ms in _model_times (#3501)

HolyFalafel committed 2 years ago

Verified d755b9d6

attn layer_past print

molly-smith committed 2 years ago

085e469a

add attention prints

molly-smith committed 2 years ago

e82e81cf

add flags to run base mlp and ds mlp.

awan-10 committed 2 years ago

81d9c1aa

add enable/disable debug flag.

awan-10 committed 2 years ago

535342bb

Expose Consecutive Hysteresis to Users (#3553)

Quentin-Anthony committed 2 years ago

Verified 0411a9f8

DS init should not broadcast or move zero.Init models (#3611)

tjruwase committed 2 years ago

Verified d39c311f

bug fix (#3609)

conglongli committed 2 years ago

Verified 736bf185

baseline mlp done. matches HF e2e.

awan-10 committed 2 years ago

10540aa0

Fix op_builder against PyTorch nightly (#3596)

malfet committed 2 years ago

Verified 6622776c

add several debug prints/instrumentation to do side by side comparison.

awan-10 committed 2 years ago

d0f765b0

Fix Hybrid Engine for BLOOM (#3580)

lekurile committed 2 years ago

Verified 76679884

Fixing bf16 test (#3551)

jomayeri committed 2 years ago

Verified 49d399cd

awan-10 committed 2 years ago

f66b6a80

fix_typo (#3559)

inkcherry committed 2 years ago

Verified d1c3c0df

rraminen committed 2 years ago

Verified 2fc56841

Clone tensors to avoid torch.save bloat (#3348)

tjruwase committed 2 years ago

Verified 5c3ebd7e

Newer Older