microsoft/DeepSpeed

Pull Requests Commits

update the code from A100

Reza Yazdani committed 4 years ago

0f58eda5

Add several APIs for kernel integration into Megatron-LM

Reza Yazdani committed 4 years ago

0629bda0

Reza Yazdani committed 4 years ago

22e26b43

add new APIs to optimize megatron-LM

Reza Yazdani committed 4 years ago

65535583

bump DSE commit (#278)

jeffra committed 4 years ago

Verified 4d64b5ba

Improving deepspeed.ai website (#269)

conglongli committed 4 years ago

Verified 6379292c

Handle parameter groups smaller than DP (#273)

tjruwase committed 4 years ago

Verified 88c319aa

Ai scale (#271)

Shaden Smith committed 4 years ago

Verified 664fa30c

Update deepspeed_utils.py (#270)

samyam committed 4 years ago

Verified 224494bd

Revert "Load non-DeepSpeed checkpoints into ZeRO optimizer"

ShadenSmith committed 4 years ago

02c392f0

Load non-DeepSpeed checkpoints into ZeRO optimizer

tjruwase committed 4 years ago

54c0267e

new transformer pre-ln image (#268)

Shaden Smith committed 4 years ago

Verified 2e6d93e0

add quotes around user argument values (#267)

jeffra committed 4 years ago

Verified fedd0386

adds gtag for website analytics (#266)

Shaden Smith committed 4 years ago

Verified 9fcdc885

add the fine-tuning results (#260)

RezaYazdaniAminabadi committed 4 years ago

Verified 6e87251c

minor refactor loss scaler (#261)

chunyang-wen committed 4 years ago

Verified 96c4daab

install update: no-sudo + clean build files (#258)

jeffra committed 4 years ago

Verified f5025506

fix transformer kernel preln config (#257)

eltonzheng committed 4 years ago

Verified fc1de4ff

Support migration to FP16 optimizer (#249)

tjruwase committed 4 years ago

Verified 2312f04b

update DSE commit (#254)

jeffra committed 4 years ago

Verified f73d717c

Specify num_replicas and rank when creating sampler (#216)

vidushv committed 4 years ago

Verified 0f72988d

Add log util (#230)

chunyang-wen committed 4 years ago

Verified e1ad8803

Features links (#252)

Shaden Smith committed 4 years ago

Verified 2a1c5db1

Update paths; include information about submodule. (#250)

awan-10 committed 4 years ago

Verified fd2a8fd5

reduce memcpy between host and device (#248)

eltonzheng committed 4 years ago

Verified 8353c594

jeffra committed 4 years ago

bbd8cd7d

adding overlap_comm documentation (#247)

samyam committed 4 years ago

Verified e04e4016

Point BERT pretraining tutorial to new perf tuning. (#246)

Shaden Smith committed 4 years ago

Verified b1ddea7f

update bert images (#245)

jeffra committed 4 years ago

Verified c5c9aaaa

center images (#244)

Shaden Smith committed 4 years ago

Verified 0c77f878

Older