transformers
Add native FSDP2 module + migration
#46707
Merged
Overview
Commits
53
Changes
View On GitHub
Commits
  • add distributed config
    3outeille committed 47 days ago
  • Add native FSDP2 module and migrate FSDP imports (Phase A PR-2).
    3outeille committed 47 days ago
  • linting
    3outeille committed 47 days ago
  • unecessary
    3outeille committed 47 days ago
  • copyright edit
    3outeille committed 47 days ago
  • revert
    3outeille committed 47 days ago
  • Merge branch 'main' into split/a-pr-1-distributed-config
    3outeille committed 41 days ago
  • Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp-module
    3outeille committed 41 days ago
  • fix
    3outeille committed 41 days ago
  • fix
    3outeille committed 41 days ago
  • Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp-module
    3outeille committed 41 days ago
  • Merge branch 'main' into split/a-pr-1-distributed-config
    3outeille committed 41 days ago
  • Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp-module
    3outeille committed 41 days ago
  • remove redundant test file
    3outeille committed 40 days ago
  • Merge branch 'main' into split/a-pr-1-distributed-config
    3outeille committed 40 days ago
  • Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp-module
    3outeille committed 40 days ago
  • Update src/transformers/distributed/fsdp.py
    3outeille committed 40 days ago
  • avoid looping, just look at dict
    3outeille committed 40 days ago
  • expand_fsdp returns reshard_targets, no_reshard_targets right away
    3outeille committed 40 days ago
  • better _resolve_tied_embed_lm_head_plan
    3outeille committed 40 days ago
  • cleaning
    3outeille committed 40 days ago
  • ruff
    3outeille committed 40 days ago
  • Merge branch 'main' into split/a-pr-1-distributed-config
    3outeille committed 40 days ago
  • Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp-module
    3outeille committed 40 days ago
  • more robust detection of embed and lm_head
    3outeille committed 40 days ago
  • Merge branch 'split/a-pr-2-fsdp-module' of https://github.com/huggingface/transformers into split/a-pr-2-fsdp-module
    3outeille committed 40 days ago
  • cleaning
    3outeille committed 40 days ago
  • ruff
    3outeille committed 40 days ago
  • typo
    3outeille committed 40 days ago
  • cleaner
    3outeille committed 40 days ago
  • cleaner
    3outeille committed 40 days ago
  • Merge branch 'main' into split/a-pr-1-distributed-config
    3outeille committed 40 days ago
  • Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp-module
    3outeille committed 40 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 40 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 40 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 39 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 38 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 38 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 35 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 35 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 35 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 33 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 31 days ago
  • expand_fsdp_plan iterate over modules
    3outeille committed 31 days ago
  • Merge branch 'split/a-pr-2-fsdp-module' of https://github.com/huggingface/transformers into split/a-pr-2-fsdp-module
    3outeille committed 31 days ago
  • comment about tie embedding
    3outeille committed 31 days ago
  • add comment tied embedding
    3outeille committed 31 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 28 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 27 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 26 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 26 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 25 days ago
  • Merge branch 'main' into split/a-pr-2-fsdp-module
    3outeille committed 25 days ago
FAQ Terms Privacy Refunds Impressum
Loading