bigscience-workshop/Megatron-DeepSpeed

Pull Requests Commits

added allgather and allreduce

shoeybi committed 5 years ago

98feae4e

Merge branch 'checkpointing-fix' into 'master'

shoeybi committed 5 years ago

c20f4d48

Made topk accuracy reporting optional

Neel Kant committed 5 years ago

de6640be

Addressed Jared's comments

Neel Kant committed 5 years ago

8d7f508a

small fix for CheckpointFunction's backward() method when sone args may be NoneType

Devendra Singh Sachan committed 5 years ago

4ee0537a

One sentence options

Neel Kant committed 5 years ago

03feecbc

adding realm_index.py

Neel Kant committed 5 years ago

d9d4ce70

Create tensors on cuda rather than copying

Neel Kant committed 5 years ago

76928caa

Neel Kant committed 5 years ago

b0a3c636

Neel Kant committed 5 years ago

68283d93

Changes after running on draco

Neel Kant committed 5 years ago

44860f8d

Bring in indexing code to what was previously ict-merge

Neel Kant committed 5 years ago

a00b3c79

remove data/preprocess_data.py

Neel Kant committed 5 years ago

8f3f338a

remove ict_dataset.py

Neel Kant committed 5 years ago

a14f1442

Cosmetic changes

Neel Kant committed 5 years ago

2a3b445d

Merge branch 'master' into ict-merge

Neel Kant committed 5 years ago

ac967fa0

Add stanza NER salient span masking

Neel Kant committed 5 years ago

e7045139

Neel Kant committed 5 years ago

7b3baaaa

Neel Kant committed 5 years ago

47996737

Fix accidental comment

Neel Kant committed 5 years ago

1f514406

More ict_merge changes and interactive testing

Neel Kant committed 5 years ago

3354081f

Address most of comments from code review w/ Mohammad

Neel Kant committed 5 years ago

6495927e

Debugging done on Circe

shoeybi committed 5 years ago

b8bb0b49

Merge branch 'mmap_data_samples' into 'master'

shoeybi committed 5 years ago

46a536cc

gpt2 mmap sample map

Raul Puri committed 5 years ago

dd76c914

mmap sample map

Raul Puri committed 5 years ago

2b47c5e7

Ran and cleaned up

Neel Kant committed 5 years ago

fcc500d6

Fix samples mapping bug

Neel Kant committed 5 years ago

e3c57c82

Correct retrieval utility and add salient span preprocessing

Neel Kant committed 5 years ago

bf599e86

Merge branch 'cross_entropy_mem_opt' into 'master'

jaredcasper committed 5 years ago

cfe35fd3

Newer Older