Megatron-DeepSpeed
[Logging] Improve logging mechanism
#154
Merged

[Logging] Improve logging mechanism #154

thomasw21 merged 17 commits into main from thomas/improve_logging_facility
thomasw21
thomasw21 Testing GLU activation logger
687ca370
thomasw21 Woops
7bac5af8
thomasw21 Changing loglevel should be done in Handler
ab6277ce
thomasw21 Woops
66a08550
thomasw21 Plus the logger in the forward function
52efe9d0
thomasw21 Woops
501ff53a
thomasw21 Turns out inheritance does not play well with decorator
6a5df04f
thomasw21 The function wrapper doesn't work with inheritance
85edb673
thomasw21 hidden variable
7bd2398c
thomasw21 Add logger to jit?
4c4dd83c
thomasw21 Revert "Add logger to jit?"
18f02ab3
thomasw21 Try something else
00ae4676
thomasw21 Woops
9b97ddc4
thomasw21 Apply logic to all activations
0f618c93
thomasw21 Manually specify to which std we want to wreite
ace8dd24
thomasw21 Fix check on string matching
2700f596
thomasw21 thomasw21 requested a review from stas00 stas00 4 years ago
thomasw21 thomasw21 requested a review from jaketae jaketae 4 years ago
stas00
stas00 approved these changes on 2021-10-22
thomasw21 Remove unecessary variable
bed52a85
thomasw21 thomasw21 merged a82462b7 into main 4 years ago
thomasw21 thomasw21 deleted the thomas/improve_logging_facility branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone