bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

fix preprocessing command

stas00 committed 2 years ago

Verified 8387ae17

Removed debug dump of universal checkpoints

TevenLeScao committed 2 years ago

Verified e52bdabb

relocating to https://github.com/huggingface/transformers-bloom-inference

stas00 committed 3 years ago

09a35f53

[bloom inference scripts] improvements (#345)

stas00 committed 3 years ago

Verified 4a7bb886

Followup PR for adding generation-server (#339)

mayank31398 committed 3 years ago

Verified cd597c8f

[ds-inference bloom] tweaks (#340)

stas00 committed 3 years ago

Verified 479aac39

Add generation server scripts using HF accelerate and DS-inference (#328)

mayank31398 committed 3 years ago

Verified f9402d02

disable CI (#332)

stas00 committed 3 years ago

Verified c1139c70

BLOOM Inference via DeepSpeed-Inference, Accelerate and DeepSpeed-ZeRO (#308)

stas00 committed 3 years ago

Verified 3932c749

Reshape deepspeed checkpoint (#239)

tjruwase committed 3 years ago

Verified 0f23a729

not yet working script

stas00 committed 3 years ago

7b5f175b

Create README.md

stas00 committed 3 years ago

Verified 2ce8bb4f

Fix causal attention mask (#306)

thomasw21 committed 3 years ago

Verified 38607ae9

Add bias a weight we need to sync as well (#307)

thomasw21 committed 3 years ago

Verified 0d0d84c8

Combine Specs (#304)

Muennighoff committed 3 years ago

Verified c3be5d3f

Add support for weighted train (#299)

thomasw21 committed 3 years ago

Verified 43ab0e08

MTF train script (#295)

thomasw21 committed 3 years ago

Verified 3d5d1514

sync layer norms (#272)

stas00 committed 3 years ago

Verified e1c479e5

CI fixes (#302)

stas00 committed 3 years ago

Verified 0cb043cf

MTF dataset and packing (#293)

thomasw21 committed 3 years ago

Verified c5b88fb9

Merge MLM too fast 2 (#294)

thomasw21 committed 3 years ago

Verified 131bd43e

Eval harness (#212)

DanielHesslow committed 3 years ago

Verified 3ab0ad18

Fixed MLM dataset arguments(#290)

thomasw21 committed 3 years ago

Verified 55f8cf8b

Mlm adaptation (#287)

Lintang Sutawika committed 3 years ago

Verified 9d264312

Fix DS init (#285)

Quentin-Anthony committed 3 years ago

Verified 987663c1

Fix tflops glu computation (#283)

Muennighoff committed 3 years ago

Verified e23393fb

[valid] deadlock workaround (#282)

stas00 committed 3 years ago

Verified cb48bd2c

Fix mixed fused layer norm to mimick nn.LayerNorm for torch>1.11 (#281)

thomasw21 committed 3 years ago

Verified 908dc9cb

Update CODEOWNERS

TevenLeScao committed 3 years ago

Verified c85b7c25

Update CODEOWNERS

TevenLeScao committed 3 years ago

Verified b6266f55

Older