bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

Fixed issues with ICT pretraining

mpatwary committed 4 years ago

0a6d53ab

renaming the folders

mpatwary committed 4 years ago

9e08c477

additional cleaning

mpatwary committed 4 years ago

bc4d7779

cleaning the code

mpatwary committed 4 years ago

09d3e75c

before cleaning the comments

mpatwary committed 4 years ago

5aef7dc6

Mostofa Patwary committed 4 years ago

64ca8257

evaluation works!

Mostofa Patwary committed 4 years ago

f000a988

added pre ad post process

Mostofa Patwary committed 4 years ago

2d4bac4f

added pre ad post process

Mostofa Patwary committed 4 years ago

8c04de96

fixing model evaluation of retriver

Mostofa Patwary committed 4 years ago

c996feb1

DPR finetune and evaluation

Mostofa Patwary committed 4 years ago

4c67af2d

Mostofa Patwary committed 4 years ago

8b310d4b

DPR evaluation debugging

Mostofa Patwary committed 4 years ago

e686a9ba

removed commnets

Mostofa Patwary committed 4 years ago

2400a6ce

removed commnets

mpatwary committed 4 years ago

8766e7ee

removed commnets

mpatwary committed 4 years ago

5a3ee701

adding dpr code

mpatwary committed 4 years ago

f7195138

implementation dpr

mpatwary committed 4 years ago

34946e13

implementing DPR

mpatwary committed 4 years ago

9ad9f555

Fixed based on review recoemmendation

mpatwary committed 4 years ago

a874cbcd

ICT zeroshot evaluation code

mpatwary committed 4 years ago

034efad0

synched with latest 13B script

TevenLeScao committed 4 years ago

3c79aaca

synched with latest 13B script

TevenLeScao committed 4 years ago

64892e27

1B3 parameter setup

TevenLeScao committed 4 years ago

97dd06db

1B3 parameter setup

TevenLeScao committed 4 years ago

17e01842

1B3 parameter setup + flos counting

TevenLeScao committed 4 years ago

aefbe3bd

1B3 parameter setup + flos counting

TevenLeScao committed 4 years ago

c0fc29a6

1B3 parameter setup + flos counting

TevenLeScao committed 4 years ago

bdd75f18

initial flo count/logging setup (need to fix model parameter count)

TevenLeScao committed 4 years ago

a3a4ba46

initial flo count/logging setup (need to fix model parameter count)

TevenLeScao committed 4 years ago

5196f8a5

Newer Older