xla
allow FSDP wrapping and sharding over modules on CPU devices
#3992

Merged

allow FSDP wrapping and sharding over modules on CPU devices #3992

JackCaoG merged 2 commits into pytorch:master from ronghanghu:xla_fsdp_shard_on_host

ronghanghu force pushed from 705d954d to c4a8c320 3 years ago

vanbasten23 commented on 2022-09-14

JackCaoG requested a review from

JackCaoG 3 years ago

JackCaoG commented on 2022-09-14

allow wrapping CPU modules with XLA FSDP and directly sharding params…

b6a97e8f

update docs

53608b9b

ronghanghu force pushed from c4a8c320 to 53608b9b 3 years ago

JackCaoG added fsdp

JackCaoG approved these changes on 2022-09-14

JackCaoG merged 6a133b87 into master 3 years ago

Reviewers

JackCaoG

vanbasten23

Assignees

No one assigned

Labels

fsdp

Milestone

No milestone