PR #29563 Mamba `slow_forward` gradient fix

Mamba `slow_forward` gradient fix #29563

ArthurZucker merged 5 commits into huggingface:main from vasqu:mamba-slowforward-gradient-fix

FIX: Cached slow forward in mamba

7e465d50

formatting

796e0708

asartran commented on 2024-03-11

fix: use real `slow_forward` call instead of torch module's

1cffa8b1

asartran approved these changes on 2024-03-14

add shape assertion for mixer block test

aa84a677

adjust shape assertion

4b8bf0d7

asartran requested a review from

ArthurZucker 2 years ago

ArthurZucker approved these changes on 2024-03-27

ArthurZucker merged cefb819f into main 2 years ago

vasqu deleted the mamba-slowforward-gradient-fix branch 2 years ago

Reviewers

ArthurZucker

asartran

Assignees

No one assigned

Labels

None yet

Milestone

No milestone