transformers
Keep the cache under activation checkpointing when gradients are off
#50890
Merged

Keep the cache under activation checkpointing when gradients are off #50890

qgallouedec merged 6 commits into main from checkpoint-only-with-grad
qgallouedec
qgallouedec Activation checkpointing: run the layer as is when gradients are off,…
cb181175
qgallouedec Keep use_cache under activation checkpointing when gradients are off,…
387fb523
qgallouedec Merge branch 'main' into checkpoint-only-with-grad
aff29103
HuggingFaceDocBuilderDev
qgallouedec qgallouedec requested a review from Cyrilvallez Cyrilvallez 3 days ago
qgallouedec Merge branch 'main' into checkpoint-only-with-grad
a9d91a63
Cyrilvallez
Cyrilvallez approved these changes on 2026-11-20
qgallouedec Merge branch 'main' into checkpoint-only-with-grad
633a03b4
qgallouedec qgallouedec enabled auto-merge 8 hours ago
qgallouedec Count only the layer calls with gradients on in the checkpointing test
0f37582d
qgallouedec qgallouedec merged f2c9ee24 into main 6 hours ago
qgallouedec qgallouedec deleted the checkpoint-only-with-grad branch 6 hours ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone