PR #22095 Fix big model inference for T5 models in float16

Fix big model inference for T5 models in float16 #22095

sgugger merged 4 commits into main from fix_big_t5_float16

sgugger requested a review from

LysandreJik 2 years ago

sgugger requested a review from

younesbelkada 2 years ago

younesbelkada approved these changes on 2023-03-12

Fix big model inference for T5 models in float16

9a55c006

Apply suggestions from code review

8f7d10fd

Style

edf8082f

sgugger force pushed from 93b7bd23 to edf8082f 2 years ago

LysandreJik approved these changes on 2023-03-13

Trigger CI with latest release

ac9307c9

sgugger merged b45192ec into main 2 years ago

sgugger deleted the fix_big_t5_float16 branch 2 years ago

Reviewers

LysandreJik

younesbelkada

Assignees

No one assigned

Labels

None yet

Milestone

No milestone