transformers
Fix warning message for fp32_cpu_offloading in bitsandbytes configs
#34079

Merged

Fix warning message for fp32_cpu_offloading in bitsandbytes configs #34079

SunMarc merged 3 commits into huggingface:main from amosyou:cpu_offload_warning

change cpu offload warning for fp8 quantization

121678c9

change cpu offload warning for fp4 quantization

1b137909

SunMarc approved these changes on 2024-10-11

change cpu offload variable name for fp8 and fp4 quantization

864a48cf

amosyou requested a review from

SunMarc 1 year ago

SunMarc approved these changes on 2024-10-17

SunMarc merged aa3e35ac into main 1 year ago

Reviewers

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone