diffusers
Context Parallel w/ Ring & Ulysses & Unified Attention
#11941
Merged
Overview
Commits
62
Changes
View On GitHub

Context Parallel w/ Ring & Ulysses & Unified Attention #11941

sayakpaul merged 62 commits into main from attn-dispatcher-cp-and-training
a-r-r-o-w
a-r-r-o-w update
d7b9e429
a-r-r-o-w update
7e97e43e
a-r-r-o-w add coauthor
ecabd2a4
a-r-r-o-w improve test
ff21b7fe
a-r-r-o-w handle ip adapter params correctly
b8f7fe61
a-r-r-o-w Merge branch 'main' into to-single-file/flux
17b678fc
a-r-r-o-w fix chroma qkv fusion test
0cda91d4
a-r-r-o-w fix fastercache implementation
bc64f12c
a-r-r-o-w fix more tests
a0b276da
a-r-r-o-w fight more tests
c1415207
a-r-r-o-w add back set_attention_backend
4dcd6729
a-r-r-o-w update
576da52f
a-r-r-o-w update
e909b735
a-r-r-o-w make style
1e7217f8
a-r-r-o-w make fix-copies
4f52e349
a-r-r-o-w make ip adapter processor compatible with attention dispatcher
d9c1683b
a-r-r-o-w refactor chroma as well
a73cb396
a-r-r-o-w remove rmsnorm assert
1e6b1c51
a-r-r-o-w minify and deprecate npu/xla processors
251bb619
a-r-r-o-w Merge branch 'main' into to-single-file/flux
84d2c84e
a-r-r-o-w update
51fed508
a-r-r-o-w a-r-r-o-w requested a review from DN6 DN6 116 days ago
a-r-r-o-w a-r-r-o-w requested a review from yiyixuxu yiyixuxu 116 days ago
a-r-r-o-w a-r-r-o-w requested a review from sayakpaul sayakpaul 116 days ago
a-r-r-o-w a-r-r-o-w requested a review from SunMarc SunMarc 116 days ago
HuggingFaceDocBuilderDev
a-r-r-o-w Merge branch 'main' into to-single-file/flux
9f37b87d
a-r-r-o-w a-r-r-o-w added roadmap
a-r-r-o-w refactor
79736265
a-r-r-o-w refactor; support flash attention 2 with cp
f859fdf7
a-r-r-o-w fix
e76fc948
a-r-r-o-w support sage attention with cp
171152f2
a-r-r-o-w make torch compile compatible
62f164d0
a-r-r-o-w Merge branch 'to-single-file/flux' into attn-dispatcher-cp-and-training
731b3bbe
a-r-r-o-w Merge branch 'main' into attn-dispatcher-cp-and-training
ff8ef454
a-r-r-o-w update
26a5a5c9
sayakpaul
a-r-r-o-w
sayakpaul
sayakpaul commented on 2025-07-29
a-r-r-o-w Merge branch 'main' into attn-dispatcher-cp-and-training
1ffc03e0
a-r-r-o-w refactor
fa5d017e
a-r-r-o-w
a-r-r-o-w update
215104f4
a-r-r-o-w Merge branch 'main' into attn-dispatcher-cp-and-training
c7771842
a-r-r-o-w refactor
256d5a95
a-r-r-o-w refactor
27e1d272
a-r-r-o-w add ulysses backward
cca53814
a-r-r-o-w try to make dreambooth script work; accelerator backward not playing …
768d0ea6
a-r-r-o-w Revert "try to make dreambooth script work; accelerator backward not …
0018b62e
a-r-r-o-w Merge branch 'main' into attn-dispatcher-cp-and-training
2065acc5
a-r-r-o-w workaround compilation problems with triton when doing all-to-all
da78c5d4
a-r-r-o-w support wan
f4c1b4e9
a-r-r-o-w handle backward correctly
a820bfdc
a-r-r-o-w support qwen
ae5a7078
a-r-r-o-w Merge branch 'main' into attn-dispatcher-cp-and-training
6bf744c6
a-r-r-o-w support ltx
db2efa35
a-r-r-o-w a-r-r-o-w marked this pull request as ready for review 69 days ago
a-r-r-o-w make fix-copies
bb07c042
DN6
DN6 commented on 2025-08-28
a-r-r-o-w Update src/diffusers/models/modeling_utils.py
2aec312f
a-r-r-o-w apply review suggestions
088d909b
a-r-r-o-w update docs
f35483ad
a-r-r-o-w add explanation
c88fc999
a-r-r-o-w make fix-copies
e569785c
a-r-r-o-w add docstrings
b85c26c8
a-r-r-o-w support passing parallel_config to from_pretrained
4b2fcc19
a-r-r-o-w Merge branch 'main' into attn-dispatcher-cp-and-training
bc9fc27b
a-r-r-o-w apply review suggestions
498b191e
a-r-r-o-w make style
a5d5ef44
a-r-r-o-w Merge branch 'main' into attn-dispatcher-cp-and-training
e0c75803
a-r-r-o-w update
2ce098b8
DN6
DN6 approved these changes on 2025-09-15
a-r-r-o-w
a-r-r-o-w
a-r-r-o-w commented on 2025-09-22
DN6 Update docs/source/en/api/parallel.md
d53f7efa
a-r-r-o-w
sayakpaul
sayakpaul commented on 2025-09-24
sayakpaul up
f4b374c0
sayakpaul Merge branch 'main' into attn-dispatcher-cp-and-training
8884d978
sayakpaul
sayakpaul sayakpaul merged dcb6dd9b into main 46 days ago
sayakpaul sayakpaul deleted the attn-dispatcher-cp-and-training branch 46 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
roadmap
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum