PR #24969 Fix beam search when using model parallel

Fix GPTNeoX beam search when using parallelize

pfldy2850 committed 2 years ago

Fix beam search idx device when using model parallel

pfldy2850 committed 2 years ago

remove onnx related stuff

pfldy2850 committed 2 years ago

fix: move test_beam_search_on_multi_gpu to GenerationTesterMixin

pfldy2850 committed 2 years ago

fix: add right item to _no_split_modules of MegaPreTrainedModel

pfldy2850 committed 2 years ago

fix: add num_beams within parallelized beam_search test

pfldy2850 committed 2 years ago

transformers Fix beam search when using model parallel #24969 Merged