PR #3611 better handle FP8 with and without deepspeed

better handle FP8 with and without deepspeed #3611

SunMarc merged 6 commits into main from mixed-precision-from-env

use the state mixed precision which has undergone all preprocessing

4820a05e

IlyasMoutawwakil requested a review from

SunMarc 1 year ago

SunMarc approved these changes on 2025-06-09

Update src/accelerate/accelerator.py

29b9af30

IlyasMoutawwakil commented on 2025-06-09

Update src/accelerate/accelerator.py

14256030

accelerator state sets the mixed precision for deepspeed and fp8_enabled

5551b2c3

IlyasMoutawwakil changed the title ~~Use the state's mixed precision which has undergone all processing~~ better handle FP8 with and without deepspeed 1 year ago

IlyasMoutawwakil commented on 2025-06-09

S1ro1 approved these changes on 2025-06-09

fix

b71a9ba5

fix

d723bd84

SunMarc approved these changes on 2025-06-10

SunMarc merged b9fee48c into main 1 year ago

SunMarc deleted the mixed-precision-from-env branch 1 year ago

Reviewers

SunMarc

S1ro1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

accelerate better handle FP8 with and without deepspeed #3611 Merged

better handle FP8 with and without deepspeed #3611

accelerate
better handle FP8 with and without deepspeed
#3611

Merged