xla
Introducing experimental gradient accumulation API
#8608

Merged

Introducing experimental gradient accumulation API #8608

tengyifei merged 5 commits into pytorch:r2.6 from rpsilva-aws:rpsilva_r2.6_grad_acc

Introduce gradient accumulation leading dimension to MLP

9b453971

Introduce experimental gradient accumulation API

d9016abe

Revert the result validation

2980f012

Separate MLP training files

a7d47a3f

rpsilva-aws changed the base branch from master to r2.6 1 year ago

rpsilva-aws marked this pull request as ready for review 1 year ago

jeffhataws approved these changes on 2025-01-22

tengyifei added tpuci

Re-introduce result validation for checkpointing

386b17b5

rpsilva-aws force pushed from e295e50c to 386b17b5 1 year ago

jeffhataws requested a review from

tengyifei 1 year ago

tengyifei approved these changes on 2025-01-22

tengyifei merged 728f14de into r2.6 1 year ago

Reviewers

tengyifei

jeffhataws

Assignees

No one assigned

Labels

None yet

Milestone

No milestone