llama-cookbook
adding HSDP as sharding strategy for FSDP training composable with PEFT
#281

Merged

adding HSDP as sharding strategy for FSDP training composable with PEFT #281

HamidShojanazeri merged 8 commits into main from ssdp

adding hsdp

38c8cf08

facebook-github-bot added cla signed

awgu approved these changes on 2023-11-01

Update src/llama_recipes/configs/fsdp.py

046e91ce

Update src/llama_recipes/utils/fsdp_utils.py

e9d5cfdf

Update README.md

ab7ae1a8

fix typos

aa24e8f5

adding missing words

b15fb145

HamidShojanazeri requested a review from

chauhang 2 years ago

Merge branch 'main' into ssdp

9ba2e028

Merge branch 'main' into ssdp

43ea6bfa

lessw2020 commented on 2024-02-07

lessw2020 approved these changes on 2024-02-07

HamidShojanazeri merged e9985fc4 into main 1 year ago

Reviewers

lessw2020

awgu

chauhang

Assignees

No one assigned

Labels

cla signed

Milestone

No milestone