PR #3585 [FSDP2] Refactor + FP8

[FSDP2] Refactor + FP8 #3585

SunMarc merged 18 commits into main from fp8-tmp

Fix double wrap

aae71711

Clocking off, ~equal to torch baseline

13d3beca

works?

2daac20b

Working version

1dff78af

Partial rewrite

cf482898

S1ro1 force pushed from 45454ef7 to cf482898 200 days ago

FSDP2 path works

098077c4

Fix back prepare

563f08e3

Almost done, proper AC left

085385fb

Feat: should work, cleanup + test more benchmarks left

6e62e389

S1ro1 changed the title ~~[FSDP2, Do not merge] FP8 adjustments~~ [FSDP2, Do not merge] Refactor 199 days ago

Style+quality

ba4d0c5c

Feat: fp8 example

ac1918dd

Feat: better example

60683b6f

Feat: add readme

6f0b5424

Docs + should be done

339dd286

Fix: typos

ab5c6353

S1ro1 changed the title ~~[FSDP2, Do not merge] Refactor~~ [FSDP2] Refactor + FP8 195 days ago

Fix: protect imports

23edcc93

S1ro1 marked this pull request as ready for review 195 days ago

SunMarc requested a review from

SunMarc 194 days ago

SunMarc commented on 2025-06-03

Feat: address comments

f315aaba

Feat: add flops image

2c2f5e67

SunMarc approved these changes on 2025-06-10

yh8899 commented on 2025-06-10

SunMarc merged d2e6b031 into main 187 days ago

SunMarc deleted the fp8-tmp branch 187 days ago

Reviewers

SunMarc

yh8899

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

accelerate [FSDP2] Refactor + FP8 #3585 Merged

[FSDP2] Refactor + FP8 #3585

accelerate
[FSDP2] Refactor + FP8
#3585

Merged