PR #38290 [`OPT`] Fix attention scaling

[`OPT`] Fix attention scaling #38290

vasqu merged 3 commits into main from vas-fix-opt

fix opt attention scaling

abc06b44

vasqu marked this pull request as ready for review 1 year ago

github-actions requested a review from

ArthurZucker 1 year ago

vasqu requested a review from

zucchini-nlp 1 year ago

Merge branch 'main' into vas-fix-opt

dc51611c

zucchini-nlp commented on 2025-05-22

zucchini-nlp approved these changes on 2025-05-22

add comment to why we do this

d2c70021

ArthurZucker approved these changes on 2025-05-26

vasqu merged d03a3ca6 into main 363 days ago

vasqu deleted the vas-fix-opt branch 363 days ago

vasqu added for patch

Reviewers

ArthurZucker

zucchini-nlp

Assignees

No one assigned

Labels

for patch

Milestone

No milestone