transformers
Test: generate with `torch.compile(model.forward)` as a fast test
#34544

Merged

Test: generate with `torch.compile(model.forward)` as a fast test #34544

gante merged 13 commits into huggingface:main from gante:generate_forward_compile_fix

fix tests

c9e3ed66

gante requested a review from

ydshieh 1 year ago

gante requested a review from

ArthurZucker 1 year ago

gante commented on 2024-10-31

ydshieh commented on 2024-10-31

ydshieh approved these changes on 2024-10-31

ArthurZucker commented on 2024-11-05

Merge branch 'main' into generate_forward_compile_fix

04d5adf3

gante commented on 2025-01-22

Update tests/generation/test_utils.py

d789a572

make fixup

43f96af1

tmp commit

3f165c81

rely on auto compilation for the tests

524b3cb4

ArthurZucker approved these changes on 2025-01-27

fix a few more cases (a few to go)

ab51b67d

all working :D

7777cf15

Merge branch 'main' into generate_forward_compile_fix

16804ea1

make fixup

07539631

add compile cache reset

44306848

allow compilation on cpu

bc4e8b31

Merge branch 'main' into generate_forward_compile_fix

f22e86b5

gante merged ece8c424 into main 361 days ago

gante deleted the generate_forward_compile_fix branch 361 days ago

Reviewers

ArthurZucker

ydshieh

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Test: generate with `torch.compile(model.forward)` as a fast test #34544 Merged

Test: generate with `torch.compile(model.forward)` as a fast test #34544

transformers
Test: generate with `torch.compile(model.forward)` as a fast test
#34544

Merged