transformers
WIP: Initial support for bnb 4bit on any nn.Parameter
#39859

Open

WIP: Initial support for bnb 4bit on any nn.Parameter #39859

matthewdouglas wants to merge 8 commits into main from bnb-parametrize-4bit

matthewdouglas requested a review from

BenjaminBossan 241 days ago

matthewdouglas requested a review from

SunMarc 241 days ago

SunMarc commented on 2025-08-07

matthewdouglas force pushed from 59029b6c to 9a7a30fd 235 days ago

matthewdouglas force pushed from 78d55b30 to 61fdac59 228 days ago

matthewdouglas force pushed from 2131f9bd to 19a008fb 209 days ago

matthewdouglas force pushed from 19a008fb to fbf30444 201 days ago

Initial support for bnb 4bit on any nn.Parameter

3b8add56

Fix style

923615b4

Fix copies

d1434a91

Enable bnb 4bit nn.Parameter from prequantized checkpoint

5fa758b8

typo

cd2c33f2

Update config name

23934d59

matthewdouglas force pushed from fbf30444 to 23934d59 193 days ago

fixup TODOs

05ddddd0

check the parametrization

464230cd

Reviewers

SunMarc

BenjaminBossan

Assignees

No one assigned

Labels

None yet

Milestone

No milestone