accelerate
Add Upcasting for FSDP in Mixed Precision. Add Concept Guide for FSPD and DeepSpeed.
#2674
Merged

Add Upcasting for FSDP in Mixed Precision. Add Concept Guide for FSPD and DeepSpeed. #2674

fabianlim
fabianlim draft fsdp vs ds
3c3cf2e7
fabianlim reframe to migration doc
35af870e
fabianlim updated functionality section
c67249fb
fabianlim cast to float32
fd81eb13
fabianlim improvements to float32 casting
c650673e
fabianlim some cleanup
2bf8b9cd
fabianlim fabianlim force pushed from 93c9e76d to 2bf8b9cd 1 year ago
pacman100
pacman100 commented on 2024-04-16
HuggingFaceDocBuilderDev
fabianlim addressed @pacman100's comments
d68c5d36
muellerzr
muellerzr commented on 2024-04-18
fabianlim Apply some of @muellerz suggestions
c9794e78
fabianlim change to subsections
af71e9f7
fabianlim changed the manner upcasting warnings are surfaced
0b8e97c9
fabianlim fabianlim force pushed from ffc2299a to 0b8e97c9 1 year ago
fabianlim
shagunsodhani
fabianlim
shagunsodhani
fabianlim
shagunsodhani
fabianlim update document to discuss fsdp and ds plugins. minor fixes.
681c697d
fabianlim fabianlim force pushed from 2e88c7bd to 681c697d 1 year ago
fabianlim
muellerzr
muellerzr
muellerzr approved these changes on 2024-04-24
muellerzr muellerzr requested a review from pacman100 pacman100 1 year ago
fabianlim @muellerzr's new suggestions
3b74c268
fabianlim explain all-or-nothing
c366b787
pacman100
pacman100 approved these changes on 2024-04-29
fabianlim
fabianlim add @pacman100's comments
59ed2c1a
muellerzr
muellerzr
fabianlim minor fix
92125b89
fabianlim
muellerzr
muellerzr muellerzr merged 9557598c into main 1 year ago
stas00
stas00
stas00 commented on 2024-04-29
stas00
stas00 commented on 2024-04-29
fabianlim
muellerzr
fabianlim
varadhbhatnagar
stas00
stas00 commented on 2024-06-03

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone