transformers
Add optional RMSNorm support to BitNet quantization (config + layers)
#38087

Merged

Add optional RMSNorm support to BitNet quantization (config + layers) #38087

MekkCyber merged 12 commits into huggingface:main from Codys12:main

enable optional RMS in BitLinear

adf2d57e

Merge branch 'huggingface:main' into main

363bcb5f

Fix naming

35da4a66

Merge branch 'main' of https://github.com/Codys12/transformers

119e0e18

github-actions marked this pull request as draft 1 year ago

SunMarc commented on 2025-05-12

MekkCyber approved these changes on 2025-05-13

MekkCyber marked this pull request as ready for review 1 year ago

SunMarc commented on 2025-05-13

Import RMS from Llama using config.*

6eaf9d19

make fix-copies

d988db8d

ran CI loop

892170e9

SunMarc approved these changes on 2025-05-14

remove default BitNetQuantConfig values

3db37fc0

Fix BitNetQuantConfig to be Optional

d2322cd0

Fix config docstrings to match Optoinal

7380aa91

Edit docstrings to match standards

f7c2afaa

Merge branch 'main' into main

08ca087c

MekkCyber merged 1e921a3a into main 1 year ago

Reviewers

SunMarc

MekkCyber

Assignees

No one assigned

Labels

None yet

Milestone

No milestone