microsoft/DeepSpeed

Pull Requests Commits

updating docstring

Reza Yazdani committed 5 years ago

6254e461

remove transformer layer ID from the top module

Reza Yazdani committed 5 years ago

c9fb0c91

install update: no-sudo + clean build files (#258)

jeffra committed 5 years ago

Verified f5025506

fix transformer kernel preln config (#257)

eltonzheng committed 5 years ago

Verified fc1de4ff

Support migration to FP16 optimizer (#249)

tjruwase committed 5 years ago

Verified 2312f04b

update DSE commit (#254)

jeffra committed 5 years ago

Verified f73d717c

Specify num_replicas and rank when creating sampler (#216)

vidushv committed 5 years ago

Verified 0f72988d

Add log util (#230)

chunyang-wen committed 5 years ago

Verified e1ad8803

Features links (#252)

Shaden Smith committed 5 years ago

Verified 2a1c5db1

Update paths; include information about submodule. (#250)

awan-10 committed 5 years ago

Verified fd2a8fd5

reduce memcpy between host and device (#248)

eltonzheng committed 5 years ago

Verified 8353c594

jeffra committed 5 years ago

bbd8cd7d

adding overlap_comm documentation (#247)

samyam committed 5 years ago

Verified e04e4016

Point BERT pretraining tutorial to new perf tuning. (#246)

Shaden Smith committed 5 years ago

Verified b1ddea7f

update bert images (#245)

jeffra committed 5 years ago

Verified c5c9aaaa

center images (#244)

Shaden Smith committed 5 years ago

Verified 0c77f878

Image links (#243)

Shaden Smith committed 5 years ago

Verified c7d0b0ca

update bert tutorial

jeffra committed 5 years ago

6622de16

jeffra committed 5 years ago

dddc526e

Transformer kernel release (#242)

jeffra committed 5 years ago

Verified 734d8991

fix: typo (#238)

chunyang-wen committed 5 years ago

Verified b652395e

remove redundant init code (#234)

chunyang-wen committed 5 years ago

Verified 6fe0edb8

if using lamb force legacy_fusion=True (#236)

jeffra committed 5 years ago

Verified a2b75527

add support for predivide as a config option (#235)

jeffra committed 5 years ago

Verified bc36b91d

Default Contiguous Gradients False (#239)

samyam committed 5 years ago

Verified 01e848b3

Samyamr/cpu memory bloat fix zero (#233)

samyam committed 5 years ago

Verified d24d3de9

Support fp32 grad clipping and fix max_grad_norm confusion (#232)

jeffra committed 5 years ago

Verified abe2204d

updating website packages (#231)

Shaden Smith committed 5 years ago

Verified 6a9d57f6

fix redundant (#228)

chunyang-wen committed 5 years ago

Verified b466e84e

Tense fix (#225)

Shaden Smith committed 5 years ago

Verified e62afbc8

Older