DeepSpeed
Ulysses SP for HF Integration
#7268
Merged
Overview
Commits
39
Changes
View On GitHub
Commits
  • add ds_grad_is_ready flag support
    sfc-gh-sbekman committed 1 year ago
  • light sp mpu adaptation
    sfc-gh-sbekman committed 1 year ago
  • expand debug + revert bad ds PR that lead to mem leak
    sfc-gh-sbekman committed 1 year ago
  • a lightweight version of MPU
    sfc-gh-sbekman committed 1 year ago
  • style
    sfc-gh-sbekman committed 1 year ago
  • add all_gather_object
    sfc-gh-sbekman committed 1 year ago
  • bulk of ulysses sp + features
    sfc-gh-sbekman committed 1 year ago
  • init file
    stas00 committed 1 year ago
  • Merge remote-tracking branch 'origin/master' into ulysses
    stas00 committed 1 year ago
  • fix
    stas00 committed 1 year ago
  • get world_size correct for SP
    stas00 committed 1 year ago
  • improve
    stas00 committed 1 year ago
  • re-org
    stas00 committed 1 year ago
  • cleanup
    stas00 committed 1 year ago
  • cleanup
    stas00 committed 1 year ago
  • move
    stas00 committed 1 year ago
  • cleanup
    stas00 committed 1 year ago
  • refactor
    stas00 committed 1 year ago
  • Merge remote-tracking branch 'origin/master' into ulysses
    stas00 committed 1 year ago
  • fix
    stas00 committed 1 year ago
  • Merge remote-tracking branch 'origin/master' into ulysses
    stas00 committed 1 year ago
  • add tests
    stas00 committed 1 year ago
  • make move_to_device more generic
    stas00 committed 1 year ago
  • improvements
    stas00 committed 1 year ago
  • transformers requirements
    stas00 committed 1 year ago
  • don't use old attn version
    stas00 committed 1 year ago
  • fix tiled mlp
    stas00 committed 1 year ago
  • Merge remote-tracking branch 'origin/master' into ulysses
    stas00 committed 1 year ago
  • cleanup
    stas00 committed 1 year ago
  • Merge branch 'master' into ulysses
    stas00 committed 1 year ago
  • install transformers anchor version last
    stas00 committed 1 year ago
  • Merge branch 'ulysses' of https://github.com:/deepspeedai/DeepSpeed into ulysses
    stas00 committed 1 year ago
  • Update deepspeed/runtime/sequence_parallel/ulysses_sp.py
    stas00 committed 1 year ago
  • copyright fix
    stas00 committed 1 year ago
  • replay fix
    stas00 committed 1 year ago
  • Merge branch 'master' into ulysses
    stas00 committed 1 year ago
  • revert
    stas00 committed 1 year ago
  • explanations
    stas00 committed 1 year ago
  • Merge branch 'ulysses' of https://github.com:/deepspeedai/DeepSpeed into ulysses
    stas00 committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading