transformers
[bnb] Let's make serialization of 4bit models possible
#26037

Merged

[bnb] Let's make serialization of 4bit models possible #26037

younesbelkada merged 22 commits into huggingface:main from poedator:save4

poedator changed the title ~~Save in 4bit - [WIP] draft PR ot fork~~ Save in 4bit - [WIP] draft PR 2 years ago

poedator changed the title ~~Save in 4bit - [WIP] draft PR~~ [WiP] Support saving and loading in 4 bits bitsandbytes formats 2 years ago

poedator marked this pull request as ready for review 2 years ago

younesbelkada commented on 2023-09-11

poedator force pushed to 0c7adba7 2 years ago

poedator changed the title ~~[WiP] Support saving and loading in 4 bits bitsandbytes formats~~ [bnb] Let's make serialization of 4bit models possible 2 years ago

younesbelkada commented on 2023-09-22

younesbelkada requested a review from

SunMarc 2 years ago

huggingface deleted a comment from github-actions on 2023-10-23

poedator force pushed from d8e99d4d 2 years ago

younesbelkada commented on 2023-11-09

poedator force pushed 2 years ago

poedator force pushed to 4973678d 2 years ago

younesbelkada commented on 2023-12-11

younesbelkada commented on 2023-12-14

poedator force pushed to cc50c8cb 2 years ago

younesbelkada approved these changes on 2023-12-14

SunMarc approved these changes on 2023-12-15

SunMarc requested a review from

SunMarc 2 years ago

SunMarc approved these changes on 2023-12-18

SunMarc requested a review from

amyeroberts 2 years ago

updated bitsandbytes.py

8d927d76

rm test_raise_* from test_4bit.py

399de0b9

add test_4bit_serialization.py

f2e88ced

modeling_utils bulk edits

f5c0f458

bnb_ver 0.41.3 in integrations/bitsandbytes.py

1daeb7eb

@slow reinstated

5dc26e10

bnb ver 0.41.3 in src/transformers/modeling_utils.py

6c4c7cd4

rm bnb version todo in integrations/bitsandbytes.py

f45a3b5b

moved 4b serialization tests to test_4bit

24789ed6

tests upd for opt

4063ac93

to torch_device

3b6f5591

ruff fixes to tests

622ab01e

rm redundant bnb version check in mod_utils

03486c2c

restore _hf_peft_config_loaded modeling_utils.py::2188

76ef0256

restore _hf_peft_config_loaded test in modeling_utils.py::2199

06c5e537

fixed NOT getattr(self, "is_8bit_serializable")

0b74ad0c

setting model.is_4bit_serializable

a61bbe50

rm separate fp16_statistics arg from set_module...

dc77d010

rm else branch in integrations::bnb::set_module

075be0fb

bnb 4bit dtype check

1247381c

upd comment on 4bit weights

eea464f7

poedator force pushed to eea464f7 2 years ago

amyeroberts commented on 2023-12-19

upd tests for FP4 safe

f18e6ac8

poedator force pushed to f18e6ac8 2 years ago

amyeroberts approved these changes on 2023-12-20

younesbelkada approved these changes on 2023-12-21

younesbelkada merged 4f7806ef into main 2 years ago

poedator deleted the save4 branch 1 year ago

Reviewers

SunMarc

younesbelkada

amyeroberts

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers [bnb] Let's make serialization of 4bit models possible #26037 Merged

[bnb] Let's make serialization of 4bit models possible #26037

transformers
[bnb] Let's make serialization of 4bit models possible
#26037

Merged