bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

Merge remote-tracking branch 'origin/main' into log-grad-norm

stas00 committed 3 years ago

f689231c

Revert "tflops for CL (#224)" (#225)

stas00 committed 3 years ago

Verified d231e117

Merge remote-tracking branch 'origin/main' into log-grad-norm

stas00 committed 3 years ago

20c9bfb3

tflops for CL (#224)

stas00 committed 3 years ago

Verified e4f2a08f

Merge remote-tracking branch 'origin/main' into log-grad-norm

stas00 committed 3 years ago

3dd99121

fix tflops calculation (#223)

stas00 committed 3 years ago

Verified d1143a7e

rename to an easier to remember ModelInspector

stas00 committed 4 years ago

f135a172

rename to an easier to remember ModuleInspector

stas00 committed 4 years ago

5aa8c248

skip params on bwd; add argmin/argmax

stas00 committed 4 years ago

349c45c7

switch to pp_rank as a global unique identifier

stas00 committed 4 years ago

0aeab4f8

Merge remote-tracking branch 'origin/main' into log-grad-norm

stas00 committed 4 years ago

2c9c6655

[logging] synced print (#217)

stas00 committed 4 years ago

Verified 4ed19efb

Merge remote-tracking branch 'origin/main' into log-grad-norm

stas00 committed 4 years ago

114c473f

improve build (#207)

stas00 committed 4 years ago

Verified 10386f89

Merge remote-tracking branch 'origin/main' into log-grad-norm

stas00 committed 4 years ago

cc6d66a8

replay layer_norm_cuda_kernel.cu fixes (#216)

stas00 committed 4 years ago

Verified 16e411e2

[TB] add throughput graphs (#210)

stas00 committed 4 years ago

Verified e53fd737

Fix consumed_valid_samples counting for several valid dataloaders

TevenLeScao committed 4 years ago

Verified 06cfbec7

Revert "Checking we use fused kernels to compute scaled masked softmax on prefix lm (#209)"

thomasw21 committed 4 years ago

c9afebc6

Checking we use fused kernels to compute scaled masked softmax on prefix lm (#209)

thomasw21 committed 4 years ago

Verified b227590f

Reweighting strat for prefix lm (#190)

thomasw21 committed 4 years ago

Verified b3cf1755

chore: add tmp directory to `.gitignore` (#205)

jaketae committed 4 years ago

Verified 12026680

[test] `--partition-activations` (#184)

stas00 committed 4 years ago

Verified 4e696193

param size printing revamp (#202)

stas00 committed 4 years ago

Verified fd1e1da9

Merge remote-tracking branch 'origin/main' into log-grad-norm

stas00 committed 4 years ago

98e153f3

[WIP] dealing with multi-process noise (#193)

stas00 committed 4 years ago

Verified 5d3150c7

elastic launcher compatible init_process_group (#201)

stas00 committed 4 years ago

Verified df5a5c4e

add missing space (#200)

SaulLu committed 4 years ago

Verified 3487f315

[CI] fix which tests get run (#199)

stas00 committed 4 years ago

Verified e9558293

Delete unnecessary brackets (#197)

SaulLu committed 4 years ago

Verified aa7fa931

Older