PR #32686 Fix: Mamba2 `norm_before_gate` usage

Fix: Mamba2 `norm_before_gate` usage #32686

ArthurZucker merged 3 commits into huggingface:main from vasqu:mamba2-gated-norm-fix

molbap approved these changes on 2024-08-14

ArthurZucker commented on 2024-08-19

mamba2 uses norm_before_gate=False

b72e876b

small nit

4f0ce72f

remove norm_before_gate flag and follow False path only

7d01af04

vasqu force pushed to 7d01af04 1 year ago

ArthurZucker approved these changes on 2024-08-20

ArthurZucker merged c63a3d0f into main 1 year ago

vasqu deleted the mamba2-gated-norm-fix branch 1 year ago

Reviewers

ArthurZucker

molbap

Assignees

No one assigned

Labels

None yet

Milestone

No milestone