transformers
Fix `GenerationMixin.generate` compatibility with pytorch profiler
#31935

Merged

Fix `GenerationMixin.generate` compatibility with pytorch profiler #31935

gante merged 1 commit into huggingface:main from fxmarty:fix-generate-profiling

use torch.compiler.is_compiling() when possible

f3f03f3d

fxmarty requested a review from

gante 1 year ago

gante approved these changes on 2024-07-12

gante requested a review from

amyeroberts 1 year ago

amyeroberts commented on 2024-07-12

amyeroberts approved these changes on 2024-07-12

gante merged 8480fda6 into main 1 year ago

Reviewers

amyeroberts

gante

Assignees

No one assigned

Labels

None yet

Milestone

No milestone