Keep the cache under activation checkpointing when gradients are off #50890
Activation checkpointing: run the layer as is when gradients are off,…
cb181175
Keep use_cache under activation checkpointing when gradients are off,…
387fb523
Merge branch 'main' into checkpoint-only-with-grad
aff29103
Merge branch 'main' into checkpoint-only-with-grad
a9d91a63
Merge branch 'main' into checkpoint-only-with-grad
633a03b4
Count only the layer calls with gradients on in the checkpointing test
0f37582d
qgallouedec
deleted the checkpoint-only-with-grad branch 6 hours ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub