xla
[FSDP] Use state_dict hook to save shard metadata for consolidating checkpoint
#4572

Merged

[FSDP] Use state_dict hook to save shard metadata for consolidating checkpoint #4572

JackCaoG merged 5 commits into pytorch:master from YangFei1990:fix_fsdp_consolidate_checkpoint

use state_dict hook to save shard metadata

d696ce37

JackCaoG requested a review from

ronghanghu 3 years ago

ronghanghu commented on 2023-02-07

Revert "use state_dict hook to save shard metadata"

21591d25

use remove_duplicate to support module reuse

06201dd0

ronghanghu approved these changes on 2023-02-10

applying format

73dcea17

Merge branch 'pytorch:master' into fix_fsdp_consolidate_checkpoint

869eeac1

JackCaoG merged d13090c4 into master 3 years ago

YangFei1990 deleted the fix_fsdp_consolidate_checkpoint branch 3 years ago

Reviewers

ronghanghu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone