bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

[bloom inference scripts] improvements

stas00 committed 3 years ago

8823be6e

stas00 committed 3 years ago

a57c2a50

stas00 committed 3 years ago

287eee14

stas00 committed 3 years ago

e197ca73

stas00 committed 3 years ago

0b50aa31

stas00 committed 3 years ago

5160733b

stas00 committed 3 years ago

17c5d222

stas00 committed 3 years ago

62e9b6ba

stas00 committed 3 years ago

400677ab

stas00 committed 3 years ago

a2ab73a3

stas00 committed 3 years ago

76e14b7d

stas00 committed 3 years ago

96bd33cb

stas00 committed 3 years ago

01a01fc0

stas00 committed 3 years ago

899a2c1b

stas00 committed 3 years ago

fbda721c

stas00 committed 3 years ago

e9344bd1

stas00 committed 3 years ago

b493db25

stas00 committed 3 years ago

4c7532cc

Add generation server scripts using HF accelerate and DS-inference (#328)

mayank31398 committed 3 years ago

Verified f9402d02

disable CI (#332)

stas00 committed 3 years ago

Verified c1139c70

BLOOM Inference via DeepSpeed-Inference, Accelerate and DeepSpeed-ZeRO (#308)

stas00 committed 3 years ago

Verified 3932c749

Reshape deepspeed checkpoint (#239)

tjruwase committed 3 years ago

Verified 0f23a729

not yet working script

stas00 committed 3 years ago

7b5f175b

Create README.md

stas00 committed 3 years ago

Verified 2ce8bb4f

Fix causal attention mask (#306)

thomasw21 committed 3 years ago

Verified 38607ae9

Add bias a weight we need to sync as well (#307)

thomasw21 committed 3 years ago

Verified 0d0d84c8

Combine Specs (#304)

Muennighoff committed 3 years ago

Verified c3be5d3f

Add support for weighted train (#299)

thomasw21 committed 3 years ago

Verified 43ab0e08

MTF train script (#295)

thomasw21 committed 3 years ago

Verified 3d5d1514

sync layer norms (#272)

stas00 committed 3 years ago

Verified e1c479e5

Older