deepspeedai/DeepSpeed

Pull Requests Commits

Test with XPU changes

loadams committed 1 year ago

0f3b6f82

Update GH org references (#6998)

tjruwase committed 1 year ago

Verified fd405169

Allow NVIDIA Blackwell (#6991)

fabiendupont committed 1 year ago

Verified f4caed6d

Update A6000 workflows to use newer docker container - 24.09 vs 24.03 (#6967)

loadams committed 1 year ago

Verified 241bffde

Use ds-specific module id to avoid conflicts (#6847)

tjruwase committed 1 year ago

Verified 029e0a33

Remove assumption that padding only occurs on last rank (#6974)

xylian86 committed 1 year ago

Verified 4fea41f4

Specify torchvision in nv-ds-chat workflow (prevents errors with torch 2.6) (#6982)

loadams committed 1 year ago

Verified c963c21f

Title: Fix setup_env_ranks to Properly Set Environment Variables Instead of Raising Error (#6979)

fabiosanger committed 1 year ago

Verified 065ca8a6

Update recommended Windows whl building versions (#6983)

loadams committed 1 year ago

Verified 8bb4d442

generalize deepspeed linear and implement it for non cuda systems (#6932)

oelayan7 committed 1 year ago

Verified 593de925

Update torch versions to support 2.6 (#6977)

loadams committed 1 year ago

Verified 8ad48725

Add CUDA 12.8 support and comment on CUDA 12.7 (#6975)

loadams committed 1 year ago

Verified 46c6c9e6

Update build_win.bat script to exclue GDS op as it lacks Windows support. (#6971)

loadams committed 1 year ago

Verified 1640f6df

Precisely track nvme optimizer offload (#6963)

tjruwase committed 1 year ago

Verified 470dd6dc

Update version.txt after 0.16.3 release (#6965)

loadams committed 1 year ago

Verified de4596be

Using explicit GPU upcast for ZeRO-Offload (#6962)

xylian86 committed 1 year ago

Verified c17dc33c

Update `torch.norm` to `torch.linalg.norm` and `torch.linalg.vector_norm` (#6931)

loadams committed 1 year ago

Verified 8d1bc0a0

Add the missing view operations from sequence parallel(async). (#6750)

inkcherry committed 1 year ago

Verified bc76b04e

Remove Duplicate Declaration of pandas in `Dockerfile` (#6959)

Zerohertz committed 1 year ago

Verified 7f3d669b

Update import for torchvision.transformers (#6958)

loadams committed 1 year ago

Verified f97f0885

Add extra_repr to Linear classes for debugging purpose (#6954)

Xia-Weiwen committed 1 year ago

Verified 018ece5a

`warn` to `warning` (#6952)

qgallouedec committed 1 year ago

Verified 05eaf3d1

[inf] Add config var to enable keeping module on host (#6846)

oelayan7 committed 1 year ago

Verified fae714d6

Pin nv-a6000 workflow (#6938)

loadams committed 1 year ago

Verified 66d3d3e9

Remove op compilation flags due to perf issue (#6944)

NirSonnenschein committed 1 year ago

Verified 396f8db7

Support pure meta model lm_head tp (#6812)

Yejing-Lai committed 1 year ago

Verified fa8db5cf

Add information on security expectations with this software (#6941)

loadams committed 1 year ago

Verified 1d15ef0a

Add position_ids arg to OPTEmbedding forward function (#6939)

lekurile committed 1 year ago

Verified 0fc3daad

Add deepseek autotp (#6937)

Yejing-Lai committed 1 year ago

Verified 45fce45c

Fix windows blog examples (#6934)

loadams committed 1 year ago

Verified 53fb5795

Older