PR #1699 Add offload for 8-bit model

Add offload for 8-bit model #1699

SunMarc merged 7 commits into huggingface:main from SunMarc:offload_8_bit

Add offload for 8-bit model

b19f9dc8

fix saved 8bit model offload and add tests

4a0b3c74

SunMarc requested a review from

younesbelkada 2 years ago

SunMarc requested a review from

sgugger 2 years ago

younesbelkada commented on 2023-07-11

sgugger commented on 2023-07-11

Update src/accelerate/utils/modeling.py

e7875d5e

Update src/accelerate/utils/modeling.py

ddeb4c2d

add doc on how offload works

826659aa

remove enable_offload

50ca6303

sgugger approved these changes on 2023-07-11

make style doc

c369fb07

younesbelkada approved these changes on 2023-07-11

SunMarc merged 27d29087 into main 2 years ago

SunMarc deleted the offload_8_bit branch 2 years ago

Reviewers

sgugger

younesbelkada

Assignees

No one assigned

Labels

None yet

Milestone

No milestone