deepspeedai/DeepSpeed

Pull Requests Commits

allow list (#3042)

satpalsr committed 3 years ago

Verified 5c2a81c2

Fix nebula in save_16bit_model issue (#3023)

FreyaRao committed 3 years ago

Verified a78d6b89

Softmax Scheduling Cleanup (#3046)

cmikeh2 committed 3 years ago

Verified 1286e374

Remove bf16 from inference config dtye enum (#3010)

molly-smith committed 3 years ago

Verified 27e1b02d

fix return prev key and value , added strides to from_blob (#2828)

mzusman committed 3 years ago

Verified 871c8a3f

[CI] follow-up fixes (#3072)

jeffra committed 3 years ago

Verified 36677588

Assert mp_size is factor of model dimensions (#2891)

molly-smith committed 3 years ago

Verified 9ea0fdc2

Several fixes to unblock CI (#3047)

loadams committed 3 years ago

Verified 4e068623

[docs] add MCR-DL paper to readme/docs (#3066)

Quentin-Anthony committed 3 years ago

Verified b38b3036

Fix Broken Links (#3048)

satpalsr committed 3 years ago

Verified f1e4fb0b

update email info

jeffra committed 3 years ago

Verified bbfd0a6a

Improve loss overflow logs (#3008)

Quentin-Anthony committed 3 years ago

Verified ac2c9ffa

Convert model parameters from generator to list. (#3017)

jomayeri committed 3 years ago

Verified 94f7da26

[logger] implement warning_once (#3021)

stas00 committed 3 years ago

Verified 50a49e42

adding attribute checks for bf opt with zero (#3022)

jomayeri committed 3 years ago

Verified d7c925e4

Update torch_checkpoint_engine.py (#3019)

stas00 committed 3 years ago

Verified e355863b

[docs] add new paper to readme/docs (#3018)

jeffra committed 3 years ago

Verified 4292e8c5

Fix buffer size for pipeline parallel and communication schedule (#2862)

tohtana committed 3 years ago

Verified b528f50e

ckpt: create directories in checkpoint_engine (#2988)

adammoody committed 3 years ago

Verified 43d58d99

Fix Meta Tensor checkpoint load for OPT models (#2990)

lekurile committed 3 years ago

Verified 3798e605

[zero] prevent poor configs from running w. zero-offload (#2971)

jeffra committed 3 years ago

Verified 457850dc

Fix issue between our abstract accelerator and colossalai's version of op_builder (#2963)

jeffra committed 3 years ago

Verified 58a4a4d4

bug fix for skipping mbs (#2171)

rahilbathwal5 committed 3 years ago

Verified 6379defa

jeffra committed 3 years ago

d58b4df3

deepspeed.init_distributed() support for TCP protocols (#2905)

noabauma committed 3 years ago

Verified db15ef57

[RFC] add device abstraction to allow other device than CUDA be used (#2221)

delock committed 3 years ago

Verified 0acf7e9c

Improve overflow handling (#2944)

tjruwase committed 3 years ago

Verified 80d8fcbd

Check for local CUDA graphs when enable_cuda_graph=True (#2941)

lekurile committed 3 years ago

Verified 87eaf8f9

AutoTP Assert Kernel Injection Support (#2939)

molly-smith committed 3 years ago

Verified 2ede0d94

TP unsupported models and assertions (#2810)

molly-smith committed 3 years ago

Verified 4ae3a3da

Newer Older