transformers
Fix gradient checkpointing + fp16 autocast for most models
#24247
Merged
Overview
Commits
15
Changes
View On GitHub

Fix gradient checkpointing + fp16 autocast for most models #24247

younesbelkada merged 15 commits into huggingface:main from younesbelkada:fix-gc-poc
younesbelkada
younesbelkada fix gc bug
e9b76963
younesbelkada younesbelkada changed the title [`PoC`] Fix gradient opt [`PoC`] Fix gradient checkpointing OPT + autocast 2 years ago
younesbelkada younesbelkada requested a review from sgugger sgugger 2 years ago
sgugger
sgugger commented on 2023-06-13
HuggingFaceDocBuilderDev
younesbelkada continue PoC on OPT
5ddfb681
ArthurZucker
ArthurZucker commented on 2023-06-14
younesbelkada fixes
52607bf4
younesbelkada :exploding_head:
4eb164c7
younesbelkada Merge branch 'main' into fix-gc-poc
d985819e
younesbelkada
younesbelkada commented on 2023-06-14
younesbelkada younesbelkada changed the title [`PoC`] Fix gradient checkpointing OPT + autocast [`PoC`] Fix gradient checkpointing + fp16 autocast 2 years ago
younesbelkada younesbelkada requested a review from sgugger sgugger 2 years ago
sgugger
sgugger commented on 2023-06-14
younesbelkada Merge branch 'main' into fix-gc-poc
3feb86df
sgugger
sgugger commented on 2023-06-15
sgugger
sgugger commented on 2023-06-20
younesbelkada younesbelkada force pushed to 3feb86df 2 years ago
younesbelkada Merge remote-tracking branch 'upstream/main' into fix-gc-poc
d15337a4
younesbelkada fix tests
375e0f95
younesbelkada
younesbelkada commented on 2023-06-20
younesbelkada remove pytest.mark
33f70432
younesbelkada fixup
92f5bbf5
sgugger
sgugger approved these changes on 2023-06-20
zhaoqf123 forward contrib credits from discussions
318d4f7d
younesbelkada younesbelkada changed the title [`PoC`] Fix gradient checkpointing + fp16 autocast Fix gradient checkpointing + fp16 autocast for most models 2 years ago
younesbelkada younesbelkada marked this pull request as ready for review 2 years ago
forward contrib credits from discussions
494ce81b
younesbelkada Merge remote-tracking branch 'upstream/main' into fix-gc-poc
c7bf81a7
younesbelkada Merge remote-tracking branch 'upstream/main' into fix-gc-poc
a6a234c9
younesbelkada reverting changes on untouched files.
d6b6be26
younesbelkada younesbelkada merged 285a4801 into main 2 years ago
younesbelkada younesbelkada deleted the fix-gc-poc branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum