DeepSpeed
Improve universal checkpoint
#5289
Merged
Overview
Commits
21
Changes
View On GitHub
Commits
  • run conversion script
    Masahiro Tanaka committed 2 years ago
  • add no-parallel path
    Masahiro Tanaka committed 2 years ago
  • improve restoring step from universal checkpoint
    Masahiro Tanaka committed 2 years ago
  • sort keys when comparing state dicts
    Masahiro Tanaka committed 2 years ago
  • add unit test for universal checkpoint
    Masahiro Tanaka committed 2 years ago
  • fix loading with load_optimizer_states=False
    Masahiro Tanaka committed 2 years ago
  • add dp scaling test
    Masahiro Tanaka committed 2 years ago
  • remove pad for comparison
    Masahiro Tanaka committed 2 years ago
  • refactor test conditions
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/unit_test_univ_cp
    Masahiro Tanaka committed 2 years ago
  • fix for torch adam
    Masahiro Tanaka committed 2 years ago
  • simplify argument
    Masahiro Tanaka committed 2 years ago
  • fix for optimizer that doesn't have step in optimizer states
    Masahiro Tanaka committed 2 years ago
  • add api to load global state to BF16 optimizer for compatibility
    Masahiro Tanaka committed 2 years ago
  • restore all fields in param group
    Masahiro Tanaka committed 2 years ago
  • Merge branch 'master' into tohtana/unit_test_univ_cp
    tohtana committed 2 years ago
  • Merge branch 'master' into tohtana/unit_test_univ_cp
    Masahiro Tanaka committed 2 years ago
  • move loading function to ZeROOptimizer
    Masahiro Tanaka committed 2 years ago
  • refactor to avoid circular import
    Masahiro Tanaka committed 2 years ago
  • fix format
    Masahiro Tanaka committed 2 years ago
  • fix method calls
    Masahiro Tanaka committed 2 years ago
FAQ Terms Privacy Refunds Impressum
Loading