PR #24969 Fix beam search when using model parallel

Fix beam search when using model parallel #24969

ArthurZucker merged 6 commits into huggingface:main from pfldy2850:fix-gpt-neox-parallelize-beam

ArthurZucker dismissed these changes on 2023-07-21

ArthurZucker requested a review from

amyeroberts 2 years ago

pfldy2850 changed the title ~~Fix GPTNeoX beam search when using parallelize~~ Fix beam search when using model parallel 2 years ago

ArthurZucker dismissed their stale review 2 years ago

Code updated

pfldy2850 force pushed 2 years ago

amyeroberts commented on 2023-07-21

amyeroberts approved these changes on 2023-07-21

ArthurZucker commented on 2023-08-03

pfldy2850 force pushed 2 years ago

amyeroberts approved these changes on 2023-08-25

pfldy2850 force pushed 2 years ago

Fix GPTNeoX beam search when using parallelize

0bdac84d

Fix beam search idx device when using model parallel

82aa0ee4

remove onnx related stuff

f82529c9

fix: move test_beam_search_on_multi_gpu to GenerationTesterMixin

79a2afb9

fix: add right item to _no_split_modules of MegaPreTrainedModel

f72e5b7c

fix: add num_beams within parallelized beam_search test

88089afc

pfldy2850 force pushed to 88089afc 2 years ago

ArthurZucker approved these changes on 2023-09-14

ArthurZucker merged 8881f38a into main 2 years ago

Reviewers

ArthurZucker

amyeroberts

Assignees

No one assigned

Labels

None yet

Milestone

No milestone