DeepSpeed
Add basic MoE timing breakdown
#1428
Merged
Overview
Commits
14
Changes
View On GitHub
Commits
  • add profiling annotations.
    awan-10 committed 4 years ago
  • add annotation to engine.
    awan-10 committed 4 years ago
  • add timers to profile moe layer and gating.
    awan-10 committed 4 years ago
  • small fix.
    awan-10 committed 4 years ago
  • Merge branch 'master' into amawa/profile-gate
    awan-10 committed 4 years ago
  • cleanup and commit final code for testing.
    awan-10 committed 4 years ago
  • remove unused import. fix comments in forward.
    awan-10 committed 4 years ago
  • Pass wallclock breakdown from engine to moe and gate.
    awan-10 committed 4 years ago
  • Merge branch 'master' into amawa/profile-gate
    awan-10 committed 4 years ago
  • Merge branch 'master' into amawa/profile-gate
    jeffra committed 4 years ago
  • Merge branch 'master' into amawa/profile-gate
    jeffra committed 4 years ago
  • Cast num_experts and num_tokens to int.
    awan-10 committed 4 years ago
  • cast num_experts and num_tokens to int (2nd instance).
    awan-10 committed 4 years ago
  • Merge branch 'master' into amawa/profile-gate
    jeffra committed 4 years ago
FAQ Terms Privacy Refunds Impressum
Loading