microsoft/DeepSpeed

Pull Requests Commits

Fix `checkpointable_layers` Logic (#6881)

Quentin-Anthony committed 362 days ago

Verified 0dbbb70b

Cleanup ops/transformer/inference tests (#6830)

loadams committed 363 days ago

Verified a8ede3a9

Stage3: Use new torch grad accumulation hooks API (#6773)

deepcharm committed 363 days ago

Verified 456c9ac6

Change compile for pipeline module torch.compile (#6478)

NirSonnenschein committed 1 year ago

Verified 3573858e

Update Gaudi2 jobs to latest 1.19 build (#6905)

raza-sikander committed 1 year ago

Verified cc03c76d

Fix error caused by all_reduce call in domino (#6880)

hwchen2017 committed 1 year ago

Verified 85cc5f9b

hpu_accelerator: use torch.use_deterministic_algorithms (#6897)

nelyahu committed 1 year ago

Verified eea53048

Zero2: avoid graph breaks in torch.compile by using param_idx (#6803)

nelyahu committed 1 year ago

Verified 00ea0c46

Allow to compile collective for PT>2.3 (#6899)

NirSonnenschein committed 1 year ago

Verified 4fd79205

Update version.txt after 0.16.2 release (#6893)

loadams committed 1 year ago

Verified f9e158a0

Update code owners (#6890)

tjruwase committed 1 year ago

Verified b344c04d

Add arctic model support by adding w2 to all_reduce (#6856)

pi314ever committed 1 year ago

Verified 0b25630a

Don't error out when cpu accelerator doesn't have torch (as default for whl building) (#6886)

loadams committed 1 year ago

Verified 4cd1d974

Update transformers ops unit tests to use `requried_torch_version` (#6884)

loadams committed 1 year ago

Verified 2f32966b

Fix --enable_each_rank_log when used with PDSH multi-node runner (#6863)

akeshet committed 1 year ago

Verified a964e435

Add MLP/lm_head tp grain size setting. (#6828)

Yejing-Lai committed 1 year ago

Verified da771ed4

Remove pin from transformers version and fix Processing/Threading issues in tests (#6822)

loadams committed 1 year ago

Verified 87c65068

Fix assertion for offloading states (#6855)

tohtana committed 1 year ago

Verified db98cc3a

Update real_accelerator.py (#6845)

keiwoo committed 1 year ago

Verified fc7c0700

Remove warnings from autodoc and sphinx (#6788)

loadams committed 1 year ago

Verified 6e3e13cb

Update TSC (#6867)

tjruwase committed 1 year ago

Verified 8efbcc49

add domino navigation (#6866)

GuanhuaWang committed 1 year ago

Verified b5e3fac6

Domino updates (#6861)

GuanhuaWang committed 1 year ago

Verified d7750c34

Fix xpu tests workflow failure by changing pip index url (#6864)

Liangliang-Ma committed 1 year ago

Verified 853a9764

Avoid poisoning process with CUDA calls as soon as importing (#6810)

HollowMan6 committed 1 year ago

Verified 91829476

Remove broken links to non-active site (#6854)

kaiksi-bb committed 1 year ago

Verified bd6fd50e

Fix nv-torch-nightly test by pinning transformers (#6849)

loadams committed 1 year ago

Verified 074d5c69

Fix uneven head sequence parallelism bug (#6774) (#6797)

Eugene29 committed 1 year ago

Verified ecb4bf32

Fix type error in `ZeROOrderedDict` (#6794)

oraluben committed 1 year ago

Verified 9e312528

Merge LoCo with Zero++ (#6730)

XingyuXie committed 1 year ago

Verified 1b58ba5e

Newer Older