transformers
use the enable_gqa param in torch.nn.functional.scaled_dot_product_at…
#39412

Merged

use the enable_gqa param in torch.nn.functional.scaled_dot_product_at… #39412

Cyrilvallez merged 9 commits into huggingface:main from sywangyi:yi_sdpa

use the enable_gqa param in torch.nn.functional.scaled_dot_product_at…

0fd2f660

liangan1 commented on 2025-07-15

ci failure fix

82cbeb2e

add check

029bc7f5

fix ci failure

67a92101

vasqu commented on 2025-07-16

refine code, extend to cuda

45b62746

refine code

883ec3ca

vasqu approved these changes on 2025-07-18

fix review comments

eb4d8adf

Cyrilvallez commented on 2025-07-21

Merge branch 'main' into yi_sdpa

a9e9454c

refine the PR

c72b3a1d

Cyrilvallez approved these changes on 2025-07-21

Cyrilvallez merged 9323d087 into main 147 days ago

sywangyi deleted the yi_sdpa branch 27 days ago

Reviewers

Cyrilvallez

vasqu

liangan1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone