bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

thomasw21 committed 4 years ago

cc2aff57

Check that the padding are ignored

thomasw21 committed 4 years ago

fe4f806c

Inverse causal masking

thomasw21 committed 4 years ago

15d95faf

Try updating the kernel

thomasw21 committed 4 years ago

8e9701b3

Try updating the kernel

thomasw21 committed 4 years ago

866fc56e

Try updating the kernel

thomasw21 committed 4 years ago

69912b3f

Try updating the kernel

thomasw21 committed 4 years ago

ef5d4d4d

Try updating the kernel

thomasw21 committed 4 years ago

84950834

Try updating the kernel

thomasw21 committed 4 years ago

d98e39a5

Try having very strict mask

thomasw21 committed 4 years ago

66040354

thomasw21 committed 4 years ago

bd4a3f07

Make it work via DS

thomasw21 committed 4 years ago

cb90679e

thomasw21 committed 4 years ago

17a6cc0a

Make it work via DS

thomasw21 committed 4 years ago

412939c0

Make it work via DS

thomasw21 committed 4 years ago

4defbb2c

Make it work via DS

thomasw21 committed 4 years ago

cbab16ca

thomasw21 committed 4 years ago

1ba5d4a1

Make it work via DS

thomasw21 committed 4 years ago

0b27fb67

Make it work via DS

thomasw21 committed 4 years ago

987e6b4b

Make it work via DS

thomasw21 committed 4 years ago

f3231db3

Make it work via DS

thomasw21 committed 4 years ago

ca8c04a7

Make it work via DS

thomasw21 committed 4 years ago

d6e435b1

Make it work via DS

thomasw21 committed 4 years ago

6a95e25e

Make it work via DS

thomasw21 committed 4 years ago

a9d423a4

Use train_batch instead

thomasw21 committed 4 years ago

aba48b3f

Turns out that test_model.py did not use deepspeed version of models

thomasw21 committed 4 years ago

06c29a9a

Tokenizer requires to have pad token

thomasw21 committed 4 years ago

a4854bd2

thomasw21 committed 4 years ago

172306b0

Add a test that the packed_masking works in the modeling side

thomasw21 committed 4 years ago

7181de45

Force gpt2 to have a pad token

thomasw21 committed 4 years ago

a8fcd386

Newer Older