PR #17994 Flax Remat for LongT5

Flax Remat for LongT5 #17994

sanchit-gandhi merged 21 commits into huggingface:main from KMFODA:flax-remat-kf

[Flax] Add remat (gradient checkpointing)

93c0a2c8

fix variable naming in test

201731d8

flip: checkpoint using a method

90443a80

fix naming

80188b60

fix class naming

ea8150a5

apply PVP's suggestions from code review

c7915740

add gradient_checkpointing to examples

250fa33c

Add gradient_checkpointing to run_mlm_flax

9bd1c811

Add remat to longt5

3c968731

Add gradient checkpointing test longt5

eeb1dad0

Fix args errors

bd829068

Fix remaining tests

66bd8fe2

KMFODA marked this pull request as draft 4 years ago

Merge remote-tracking branch 'origin/main' into flax-remat-kf

1378495a

Make fixup & quality fixes

cd1edc38

patrickvonplaten requested a review from

sanchit-gandhi 4 years ago

replace kwargs

8ab6c4f3

sanchit-gandhi commented on 2022-07-29

remove unecessary kwargs

27dfcbf0

Merge remote-tracking branch 'origin/main' into flax-remat-kf

f47f3605

Make fixup changes

4c9c50c6

KMFODA changed the base branch from main to BritneyMuller-housekeeping-patch 4 years ago

KMFODA changed the base branch from BritneyMuller-housekeeping-patch to main 4 years ago

revert long_t5_flax changes

72c60d96

KMFODA marked this pull request as ready for review 4 years ago

sanchit-gandhi commented on 2022-08-01

Remove return_dict and copy to LongT5

288edbb8

sanchit-gandhi approved these changes on 2022-08-09

sanchit-gandhi requested a review from

patil-suraj 4 years ago

Remove test_gradient_checkpointing

092359cc

sanchit-gandhi merged d6eeb871 into main 4 years ago

Reviewers

sanchit-gandhi

patil-suraj

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Flax Remat for LongT5 #17994 Merged

Flax Remat for LongT5 #17994

transformers
Flax Remat for LongT5
#17994

Merged