transformers
Fix beam search when using model parallel
#24969
Merged

Fix beam search when using model parallel #24969

pfldy2850
ArthurZucker
ArthurZucker dismissed these changes on 2023-07-21
ArthurZucker ArthurZucker requested a review from amyeroberts amyeroberts 2 years ago
HuggingFaceDocBuilderDev
pfldy2850
ArthurZucker
pfldy2850 pfldy2850 changed the title Fix GPTNeoX beam search when using parallelize Fix beam search when using model parallel 2 years ago
pfldy2850
ArthurZucker ArthurZucker dismissed their stale review 2 years ago
Code updated
ArthurZucker
pfldy2850 pfldy2850 force pushed 2 years ago
pfldy2850
amyeroberts
amyeroberts commented on 2023-07-21
amyeroberts
amyeroberts approved these changes on 2023-07-21
pfldy2850
ArthurZucker
ArthurZucker
ArthurZucker commented on 2023-08-03
pfldy2850
ArthurZucker
pfldy2850
ArthurZucker
amyeroberts
pfldy2850 pfldy2850 force pushed 2 years ago
pfldy2850
amyeroberts
amyeroberts approved these changes on 2023-08-25
dev-cotyledon
amyeroberts
amyeroberts
dev-cotyledon
pfldy2850 pfldy2850 force pushed 2 years ago
pfldy2850 Fix GPTNeoX beam search when using parallelize
0bdac84d
pfldy2850 Fix beam search idx device when using model parallel
82aa0ee4
pfldy2850 remove onnx related stuff
f82529c9
pfldy2850 fix: move test_beam_search_on_multi_gpu to GenerationTesterMixin
79a2afb9
pfldy2850 fix: add right item to _no_split_modules of MegaPreTrainedModel
f72e5b7c
pfldy2850 fix: add num_beams within parallelized beam_search test
88089afc
pfldy2850 pfldy2850 force pushed to 88089afc 2 years ago
pfldy2850
amyeroberts
ArthurZucker
ArthurZucker
ArthurZucker approved these changes on 2023-09-14
ArthurZucker ArthurZucker merged 8881f38a into main 2 years ago
ArthurZucker

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone