PR #29106 support SDPA Attention in stablelm

support SDPA Attention in stablelm #29106

younesbelkada merged 7 commits into huggingface:main from eaidova:ea/stablelm_sdpa

eaidova force pushed 2 years ago

support SDPA Attention in stablelm

8013317e

eaidova force pushed to 8013317e 2 years ago

ArthurZucker commented on 2024-02-20

eaidova force pushed 2 years ago

add integration test

9986f406

eaidova force pushed to 9986f406 2 years ago

ArthurZucker approved these changes on 2024-02-20

ArthurZucker commented on 2024-02-20

add fallback for output_attentions

3aa99e23

Update src/transformers/models/stablelm/modeling_stablelm.py

bda2f146

younesbelkada commented on 2024-02-20

Update tests/models/stablelm/test_modeling_stablelm.py

ce7c7d4f

younesbelkada commented on 2024-02-20

Update src/transformers/models/stablelm/modeling_stablelm.py

9bf6c626

eaidova force pushed 2 years ago

handle non-contiguous states

4a03d876

eaidova force pushed to 4a03d876 2 years ago

eaidova requested a review from

younesbelkada 2 years ago

younesbelkada approved these changes on 2024-02-21

younesbelkada requested a review from

ArthurZucker 2 years ago

younesbelkada merged 1d0ea7ab into main 2 years ago

Reviewers

ArthurZucker

younesbelkada

Assignees

No one assigned

Labels

None yet

Milestone

No milestone