bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
fix
stas00 committed 4 years ago
67ec9c12
fix
stas00 committed 4 years ago
4953ee70
fix
stas00 committed 4 years ago
3a95a03f
cleanup
stas00 committed 4 years ago
ac4d77e3
process staggering wip
stas00 committed 4 years ago
1d4441f6
fix comment
stas00 committed 4 years ago
d96863aa
tp test hangs w/o deepspeed.zero.Init
stas00 committed 4 years ago
8534b6d4
make tests faster - smaller model/iterations
stas00 committed 4 years ago
bcf4f7ce
fix tensor function
stas00 committed 4 years ago
f6cc6cd9
allocate on gpu directly
stas00 committed 4 years ago
d4d277e5
--abort-on-unmet-fused-kernel-constraints (#247)
stas00 committed 4 years ago
Verified 406022ed
implement kill switch (#245)
stas00 committed 4 years ago
Verified e9c8550e
Alibi Tensor Parallel Fix (#244)
DanielHesslow committed 4 years ago
Verified 40e8b2a0
[TB] log restarts (#234)
stas00 committed 4 years ago
Verified dfb5d687
Fix throughput unit (#241)
janEbert committed 4 years ago
Verified 4c2aea04
fix add_scalar for pt<1.9 (#240)
stas00 committed 4 years ago
Verified 5da3578a
enable new_style for add_scalar function for faster data format (#237)
abodacs committed 4 years ago
Verified e9750c42
[ds report] less noise (#215)
stas00 committed 4 years ago
Verified bbf311ee
fix tests (#232)
stas00 committed 4 years ago
Verified 04c461ed
implement missing --no-load-optim support for deepspeed path (#231)
stas00 committed 4 years ago
Verified efefd8a4
save args to txt file (#218)
bhavitvyamalik committed 4 years ago
Verified 14a03170
Fix alibi (#222)
thomasw21 committed 4 years ago
Verified 7ab5c05a
Revert "tflops for CL (#224)" (#225)
stas00 committed 4 years ago
Verified d231e117
tflops for CL (#224)
stas00 committed 4 years ago
Verified e4f2a08f
fix tflops calculation (#223)
stas00 committed 4 years ago
Verified d1143a7e
[logging] synced print (#217)
stas00 committed 4 years ago
Verified 4ed19efb
improve build (#207)
stas00 committed 4 years ago
Verified 10386f89
replay layer_norm_cuda_kernel.cu fixes (#216)
stas00 committed 4 years ago
Verified 16e411e2
[TB] add throughput graphs (#210)
stas00 committed 4 years ago
Verified e53fd737
Fix consumed_valid_samples counting for several valid dataloaders
TevenLeScao committed 4 years ago
Verified 06cfbec7
Terms Of Use Privacy Policy Refund Policy Impressum