[DiffusionGemma] Support gradient checkpointing #46572
kashif
force pushed
from
6ac3d9d0
to
2a7990df
102 days ago
kashif
force pushed
from
2a7990df
to
ab0bb31d
102 days ago
kashif
changed the title Support gradient checkpointing in DiffusionGemma [DiffusionGemmaSupport gradient checkpointing 102 days ago
kashif
changed the title [DiffusionGemmaSupport gradient checkpointing [DiffusionGemma] Support gradient checkpointing 102 days ago
kashif
force pushed
from
ab0bb31d
to
a4a313d8
102 days ago
kashif
force pushed
from
d0ce11c6
to
493d7947
91 days ago
kashif
force pushed
from
493d7947
to
b6322d79
91 days ago
Support gradient checkpointing in DiffusionGemma
00ee1d04
Test that checkpointing reproduces the exact loss and gradients
e039af9a
kashif
force pushed
from
b6322d79
to
e039af9a
91 days ago
Merge branch 'main' into diffusion-gemma-gradient-checkpointing
f987976a
Merge branch 'main' into diffusion-gemma-gradient-checkpointing
35d79b30
update use_cache test now that the decoder ignores it instead of raising
92555cd6
Merge branch 'main' into diffusion-gemma-gradient-checkpointing
a371e48e
Merge remote-tracking branch 'upstream/main' into diffusion-gemma-gra…
92ee0bd9
use a single read-only kv cache under gradient checkpointing
1332f74e
Merge remote-tracking branch 'upstream/main' into diffusion-gemma-gra…
0ba30cdb
Merge remote-tracking branch 'kashif/diffusion-gemma-gradient-checkpo…
beee2ceb
drop the unused encoder kv return and guard the decoder cache
edf9a694
Merge branch 'main' into diffusion-gemma-gradient-checkpointing
660a958d
Merge branch 'main' into diffusion-gemma-gradient-checkpointing
414274c4
reuse BaseModelOutputWithPast and drop the unrelated mask cast
e7abc989
Merge branch 'main' into diffusion-gemma-gradient-checkpointing
6858e113
Merge branch 'main' into diffusion-gemma-gradient-checkpointing
2812f155
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub