DeepSpeed
8295d7a8 - Fixing gelu_checkpointing memory issue (#812)

Commit
4 years ago
Fixing gelu_checkpointing memory issue (#812) * fixing buffers in transformer kernel when gelu-checkpoint is enabled * fixing the test issue for other memory optimization flags * fixing a bug for when attn_dropout_checkpoint is enabled
Parents
Loading