bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits
deploy elastic error handler (#258)
stas00 committed 4 years ago
Verified 8673d464
add `pad-vocab-size-to` argument and tests (#255)
SaulLu committed 4 years ago
Verified 58d92042
make partition_method configurable (#256)
stas00 committed 4 years ago
Verified 00f5f889
[sync] bf16 (#250)
stas00 committed 4 years ago
Verified 49d21af2
Try to read the data path arguments directly from a file (#254)
thomasw21 committed 4 years ago
Verified cf2d23a5
Use padded vocab size in preprocessing scripts (#253)
thomasw21 committed 4 years ago
Verified 99c8fe07
Fix preprocess_data_many_cores to use dtype
thomasw21 committed 4 years ago
b289eb81
Fix preprocess_data_many_cores to use dtype
thomasw21 committed 4 years ago
2c43a0fe
Use DS 3D reshaping utils
tjruwase committed 4 years ago
29ca2bcc
Replace approximate formula with exact one for throughput (#251)
deepakn94 committed 4 years ago
Verified ae6277f5
[apex FusedAdam] crash workaround (#249)
stas00 committed 4 years ago
Verified 541b967f
--abort-on-unmet-fused-kernel-constraints (#247)
stas00 committed 4 years ago
Verified 406022ed
Remove deepspeed checkpoint utils
tjruwase committed 4 years ago
9bf7ac51
implement kill switch (#245)
stas00 committed 4 years ago
Verified e9c8550e
Alibi Tensor Parallel Fix (#244)
DanielHesslow committed 4 years ago
Verified 40e8b2a0
[TB] log restarts (#234)
stas00 committed 4 years ago
Verified dfb5d687
Fix throughput unit (#241)
janEbert committed 4 years ago
Verified 4c2aea04
Fix unit tests
tjruwase committed 4 years ago
b6733d57
fix test_checkpoint_reshaping_empty_dir
stas00 committed 4 years ago
cc2fad1f
remove debug folders
stas00 committed 4 years ago
115bd313
Tests for tp/pp reshape
tjruwase committed 4 years ago
a1068e4d
Validate input folder
tjruwase committed 4 years ago
e379065b
add checkpoint tests
stas00 committed 4 years ago
675f12ca
Merge remote-tracking branch 'origin/main' into ds_ckpt_reshape
stas00 committed 4 years ago
fec1ec5f
fix add_scalar for pt<1.9 (#240)
stas00 committed 4 years ago
Verified 5da3578a
Reshape deepspeed checkpoint
tjruwase committed 4 years ago
67c08f09
enable new_style for add_scalar function for faster data format (#237)
abodacs committed 4 years ago
Verified e9750c42
[ds report] less noise (#215)
stas00 committed 4 years ago
Verified bbf311ee
fix tests (#232)
stas00 committed 4 years ago
Verified 04c461ed
implement missing --no-load-optim support for deepspeed path (#231)
stas00 committed 4 years ago
Verified efefd8a4
Terms Of Use Privacy Policy Refund Policy Impressum