transformers
[DiffusionGemma] Support gradient checkpointing
#46572
Merged

[DiffusionGemma] Support gradient checkpointing #46572

kashif
kashif kashif force pushed from 6ac3d9d0 to 2a7990df 102 days ago
HuggingFaceDocBuilderDev
kashif kashif force pushed from 2a7990df to ab0bb31d 102 days ago
kashif kashif changed the title Support gradient checkpointing in DiffusionGemma [DiffusionGemmaSupport gradient checkpointing 102 days ago
kashif kashif changed the title [DiffusionGemmaSupport gradient checkpointing [DiffusionGemma] Support gradient checkpointing 102 days ago
zucchini-nlp
zucchini-nlp commented on 2026-06-12
kashif
kashif kashif force pushed from ab0bb31d to a4a313d8 102 days ago
ArthurZucker
ArthurZucker commented on 2026-06-12
ArthurZucker
kashif
kashif
kashif
kashif
zucchini-nlp
kashif
kashif
zucchini-nlp
BenjaminBossan
kashif kashif requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 101 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-06-13
zucchini-nlp
kashif kashif requested a review from zucchini-nlp zucchini-nlp 100 days ago
zucchini-nlp
zucchini-nlp commented on 2026-06-15
kashif
github-actions
ArthurZucker
ArthurZucker commented on 2026-06-17
kashif
kashif
kashif kashif requested a review from ArthurZucker ArthurZucker 95 days ago
Cyrilvallez
Cyrilvallez commented on 2026-06-22
kashif
Cyrilvallez
kashif
kashif
kashif kashif force pushed from d0ce11c6 to 493d7947 91 days ago
kashif kashif force pushed from 493d7947 to b6322d79 91 days ago
kashif Support gradient checkpointing in DiffusionGemma
00ee1d04
kashif Test that checkpointing reproduces the exact loss and gradients
e039af9a
kashif kashif force pushed from b6322d79 to e039af9a 91 days ago
kashif Merge branch 'main' into diffusion-gemma-gradient-checkpointing
f987976a
zucchini-nlp
zucchini-nlp commented on 2026-06-24
kashif Merge branch 'main' into diffusion-gemma-gradient-checkpointing
35d79b30
kashif update use_cache test now that the decoder ignores it instead of raising
92555cd6
kashif Merge branch 'main' into diffusion-gemma-gradient-checkpointing
a371e48e
Cyrilvallez
Cyrilvallez commented on 2026-07-08
kashif
kashif Merge remote-tracking branch 'upstream/main' into diffusion-gemma-gra…
92ee0bd9
kashif use a single read-only kv cache under gradient checkpointing
1332f74e
kashif Merge remote-tracking branch 'upstream/main' into diffusion-gemma-gra…
0ba30cdb
kashif Merge remote-tracking branch 'kashif/diffusion-gemma-gradient-checkpo…
beee2ceb
zucchini-nlp
zucchini-nlp commented on 2026-07-08
kashif drop the unused encoder kv return and guard the decoder cache
edf9a694
kashif Merge branch 'main' into diffusion-gemma-gradient-checkpointing
660a958d
ArthurZucker
ArthurZucker approved these changes on 2026-07-13
kashif Merge branch 'main' into diffusion-gemma-gradient-checkpointing
414274c4
kashif reuse BaseModelOutputWithPast and drop the unrelated mask cast
e7abc989
kashif Merge branch 'main' into diffusion-gemma-gradient-checkpointing
6858e113
kashif Merge branch 'main' into diffusion-gemma-gradient-checkpointing
2812f155
github-actions
github-actions
zucchini-nlp zucchini-nlp merged 213652a5 into main 61 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone