Add basic MoE timing breakdown #1428
awan-10
merged
14 commits into
master
from
amawa/profile-gate
add profiling annotations.
fd3895da
add annotation to engine.
a71d5388
add timers to profile moe layer and gating.
3fe83665
small fix.
2ac079df
Merge branch 'master' into amawa/profile-gate
dcc3dff6
cleanup and commit final code for testing.
cae83ace
remove unused import. fix comments in forward.
1f38e873
Pass wallclock breakdown from engine to moe and gate.
6a0e83cb
Merge branch 'master' into amawa/profile-gate
bab4b0bc
Merge branch 'master' into amawa/profile-gate
ec0ad848
Merge branch 'master' into amawa/profile-gate
c49b1d55
Cast num_experts and num_tokens to int.
ec99ab84
ganik
commented
on 2021-10-13
cast num_experts and num_tokens to int (2nd instance).
9f6eae1d
ganik
approved these changes
on 2021-10-13
Merge branch 'master' into amawa/profile-gate
65861b9f
jeffra
approved these changes
on 2021-10-13
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub