transformers
[`distributed`] Context parallelism: pad the sequences to a multiple of `cp_size`
#50515

Open

[`distributed`] Context parallelism: pad the sequences to a multiple of `cp_size` #50515

3outeille wants to merge 1 commit into cp-9-ep-x-cp from cp-7-auto-pad

[distributed] Pad the sequences to a multiple of cp_size

043fd08c

3outeille force-pushed the cp-9-ep-x-cp branch from d0d2eb7e to 58051e90 2 hours ago

3outeille force pushed from 4249c6db to 043fd08c 2 hours ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone