DeepSpeed
[inference] check for unsupported model generate args
#2627

Merged

[inference] check for unsupported model generate args #2627

jeffra merged 3 commits into master from jeffra/check-gen-args

check for unsupported model generate args

d201eb95

only patch model generate if model has it

e8c2bc82

jeffra requested a review from

RezaYazdaniAminabadi 3 years ago

jeffra requested a review from

mrwyattii 3 years ago

jeffra requested a review from

awan-10 3 years ago

jeffra requested a review from

cmikeh2 3 years ago

jeffra requested a review from

arashb 3 years ago

check GenerationConfig as well

cf5e21f2

cmikeh2 approved these changes on 2022-12-19

jeffra merged 5676f5ec into master 3 years ago

jeffra deleted the jeffra/check-gen-args branch 3 years ago

Reviewers

cmikeh2

mrwyattii

awan-10

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone