transformers
[`docs`] Context parallelism with `DistributedConfig`
#50497
Open

[`docs`] Context parallelism with `DistributedConfig` #50497

3outeille wants to merge 2 commits into cp-3-cp-size from cp-5-docs
3outeille
3outeille [docs] Add a context parallelism page
dba74190
HuggingFaceDocBuilderDev
3outeille [docs] Mention models whose attention bypasses the attention interface
12ac024c

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone