transformers
Reenable SDPA's FA2 During Training with torch.compile
#30442

Merged

Reenable SDPA's FA2 During Training with torch.compile #30442

fxmarty merged 7 commits into huggingface:main from warner-benjamin:sdpa_fa2_compile

Reenable SDPA's FA2 during training with torch.compile

26e967ef

fix Olmo's SDPA FA2 dispatching too

bc8aa59a

ArthurZucker approved these changes on 2024-04-24

update formatting

76186c70

improved SDPA comment

f3f1347f

fxmarty approved these changes on 2024-04-26

formatting and explanatory comment

60837f9d

Merge branch 'huggingface:main' into sdpa_fa2_compile

9e486ae3

is_causal if statement to one-liner

0aab518d

fxmarty merged 9df8b301 into main 1 year ago

Reviewers

ArthurZucker

fxmarty

Assignees

No one assigned

Labels

None yet

Milestone

No milestone