transformers
Flash-attn performance: remove cuda sync during inference
#33570
Merged
Merged
Flash-attn performance: remove cuda sync during inference #33570
Cyrilvallez
merged
1 commit into
huggingface:main
from
Cyrilvallez:fix-flash
Switch conditions to use short-circuit during inference
a55d5f24
ArthurZucker
approved these changes
on 2024-09-20
Login to write a write a comment.
Login via GitHub