Megatron-DeepSpeed
a82462b7 - [Logging] Improve logging mechanism (#154)

Commit
4 years ago
[Logging] Improve logging mechanism (#154) * Testing GLU activation logger * Changing loglevel should be done in Handler * Plus the logger in the forward function * Turns out inheritance does not play well with decorator * The function wrapper doesn't work with inheritance * Add logger to jit? * Revert "Add logger to jit?" This reverts commit 4c4dd83ce0134cbd39c3ba3ea169764e41db8548. * Apply logic to all activations * Manually specify to which std we want to write * Fix check on string matching
Author
Parents
Loading