Megatron-DeepSpeed
Test: Add checkpoint conversion test code
#121
Open
Overview
Commits
37
Changes
View On GitHub

Test: Add checkpoint conversion test code #121

jaketae wants to merge 37 commits into main from test-conversion
jaketae
jaketae wip: add checkpoint conversion test code
022a892e
jaketae jaketae assigned jaketae jaketae 4 years ago
jaketae jaketae added test
jaketae wip: complete barebones test script
c9d008f6
jaketae fix: use correct gpt2 model import
81f30378
sIncerass resolve the relative path bug
bab1c228
sIncerass sIncerass force pushed from 2399d30d to bab1c228 4 years ago
sIncerass work version for deepspeed and transformers
6421755e
sIncerass eval mode for testing
bbd411f1
sIncerass cudnn.deterministic
d726cf21
sIncerass add test for deepspeed_to_megatron
0535e564
sIncerass sIncerass force pushed from 6017d7da to 0535e564 4 years ago
sIncerass change to gleu_new, deepspeed_to_transformers can pass torch_assert_c…
aca6cbf9
sIncerass sIncerass marked this pull request as ready for review 4 years ago
sIncerass sIncerass requested a review from ibeltagy ibeltagy 4 years ago
sIncerass correct the activation based on the ds args
f02c2420
sIncerass sIncerass requested a review from stas00 stas00 4 years ago
stas00
stas00 requested changes on 2021-10-02
jaketae Update tools/convert_checkpoint/deepspeed_to_transformers.py
e40afa4d
jaketae Update tests/test_conversion.py
3e9fcecb
jaketae Update tests/test_conversion.py
0549798c
jaketae Update tests/test_conversion.py
4abcfb6f
jaketae style: run linter
051a119d
sIncerass refactor + fp16 test, 1 fail for ds_to_hf fp16
301c3115
stas00 massage
bfcba280
stas00 new requirement
2b277b85
stas00 massage
32734c3b
stas00 localize the impact of torch.backends.cudnn.deterministic
41015baf
stas00 proper fix for relative imports
6488fd48
stas00 simplify fp32 setup
87d997fb
stas00 Merge remote-tracking branch 'origin/main' into test-conversion
01a2ce87
stas00 move library files into library
9bb52ff7
stas00 sync with the new hf conv script
15944112
stas00 cleanup
88cfb89a
stas00 fixes
7ec77f8e
stas00 reorg
43881ff5
stas00
stas00
stas00 Merge remote-tracking branch 'origin/main' into test-conversion
412053d5
stas00 wip - please ignore
cc9f37dd
stas00
stas00 Merge remote-tracking branch 'origin/main' into test-conversion
da8eb1c0
stas00 Merge remote-tracking branch 'origin/main' into test-conversion
f6fb7ef0
stas00 start using GPTMegLMHeadModel + cleanup
2e4d03b8
stas00
stas00 Merge remote-tracking branch 'origin/main' into test-conversion
642c6d89
stas00 Merge remote-tracking branch 'origin/main' into test-conversion
f0429465
stas00 Merge remote-tracking branch 'origin/main' into test-conversion
3fc0ce3b
stas00
stas00 Merge remote-tracking branch 'origin/main' into test-conversion
c923cda4
jaketae
stas00
jaketae
stas00

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
test
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum