Megatron-DeepSpeed
Fix tflops glu computation
#283
Merged

Fix tflops glu computation #283

thomasw21 merged 4 commits into main from glu_tflops
Muennighoff
Muennighoff Fix tflops glu computation
64f180b8
Muennighoff Muennighoff requested a review from stas00 stas00 3 years ago
Muennighoff Muennighoff requested a review from thomasw21 thomasw21 3 years ago
thomasw21
stas00
Muennighoff Explain GLU TFLOPs difference
4db72553
Muennighoff
Muennighoff Fix typo
29deb2b5
thomasw21
thomasw21 approved these changes on 2022-06-05
Muennighoff Specify MLP
70b5b2e5
thomasw21 thomasw21 merged e23393fb into main 3 years ago
thomasw21 thomasw21 deleted the glu_tflops branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone