transformers
[`distributed`] Train a model with context parallelism in Trainer
#50521

Open

[`distributed`] Train a model with context parallelism in Trainer #50521

3outeille wants to merge 2 commits into cp-4-tester-mixin from cp-11-trainer

3outeille force-pushed the cp-4-tester-mixin branch from a819e0f0 to 0d5d70f4 15 hours ago

3outeille force pushed from 06310a9a to 0291cac6 15 hours ago

3outeille force-pushed the cp-4-tester-mixin branch from 0d5d70f4 to c23c568d 15 hours ago

3outeille force pushed from 0291cac6 to d3f12fb4 15 hours ago

3outeille force-pushed the cp-4-tester-mixin branch from c23c568d to d1906903 12 hours ago

3outeille force pushed from d3f12fb4 to 41ec5d2b 12 hours ago

3outeille force-pushed the cp-4-tester-mixin branch from d1906903 to 681346a5 12 hours ago

3outeille force pushed from 41ec5d2b to b0562200 12 hours ago

[distributed] Train a model with context parallelism in Trainer

ae34494c

[distributed] Test the Trainer with context parallelism against a sin…

3719a79d

3outeille force-pushed the cp-4-tester-mixin branch from 681346a5 to 6df787fd 12 hours ago

3outeille force pushed from b0562200 to 3719a79d 12 hours ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone