transformers
`torch.compile` compatibility with `generate` + static cache
#29114
Merged
Overview
Commits
16
Changes
View On GitHub

`torch.compile` compatibility with `generate` + static cache #29114

fxmarty merged 16 commits into main from compile-compatibility-generate
fxmarty
fxmarty fix compatibility
6d669eea
fxmarty fxmarty marked this pull request as draft 2 years ago
fxmarty
fxmarty commented on 2024-02-19
fxmarty
fxmarty commented on 2024-02-19
fxmarty
fxmarty commented on 2024-02-19
HuggingFaceDocBuilderDev
ArthurZucker
ArthurZucker commented on 2024-02-19
fxmarty working version
48910509
fxmarty Merge branch 'main' into compile-compatibility-generate
724c6946
fxmarty cleanup
0a00d6bb
fxmarty sanity checks
74725498
fxmarty more sanity
b2147667
fxmarty
fxmarty working version WITH refactor
b9b627c6
fxmarty working without API change
0c03b7d4
fxmarty fxmarty requested a review from ArthurZucker ArthurZucker 2 years ago
fxmarty fxmarty requested a review from gante gante 2 years ago
fxmarty fxmarty requested a review from LysandreJik LysandreJik 2 years ago
fxmarty fxmarty changed the title WIP: fix `generate` compatibility with torch.compile Make torch.compile compilation >2x faster when using static cache + `generate` 2 years ago
fxmarty cleanup & tests pass
28cdee0f
fxmarty more cleaning
190e0cf2
fxmarty fxmarty marked this pull request as ready for review 2 years ago
fxmarty fxmarty requested a review from amyeroberts amyeroberts 2 years ago
fxmarty fix test
5019e81b
fxmarty fix tests
80b9072c
fxmarty
fxmarty commented on 2024-02-20
fxmarty
fxmarty commented on 2024-02-20
ArthurZucker
ArthurZucker approved these changes on 2024-02-21
fxmarty Update src/transformers/generation/utils.py
a660486e
fxmarty smaller comment
29354629
ArthurZucker
fxmarty update comment
5dbcef43
fxmarty
fxmarty fxmarty changed the title Make torch.compile compilation >2x faster when using static cache + `generate` `torch.compile` compatibility with `generate` + static cache 2 years ago
gante
gante approved these changes on 2024-02-21
gante
fxmarty update comment
a8c4e103
fxmarty
fxmarty
fxmarty fxmarty merged cc4a664b into main 2 years ago
fxmarty fxmarty deleted the compile-compatibility-generate branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum