PR #10216 [LoRA] Add LoRA support to AuraFlow

hameerabbasi force pushed from da41f328 to c8364bc9 1 year ago

hameerabbasi force pushed from 20b5f2d3 to 80ac0d49 1 year ago

hameerabbasi force pushed from 912fb8d2 to f5b9f901 1 year ago

sayakpaul requested changes on 2024-12-15

Add AuraFlowLoraLoaderMixin

e50a1082

Add comments, remove qkv fusion

658d0586

Add Tests

4208d096

Add AuraFlowLoraLoaderMixin to documentation

98b19f66

Add Suggested changes

71f8bace

Change attention_kwargs->joint_attention_kwargs

0eee03ee

Rebasing derp.

4e4f780e

fix

c07d1f51

fix

1b7f99fb

Quality fixes.

875a3e0f

make style

a242d7ae

`make fix-copies`

a73df6b9

`ruff check --fix`

894eac0a

Attept 1 to fix tests.

2b364161

Attept 2 to fix tests.

6b762b80

Attept 3 to fix tests.

bc2a4663

Address review comments.

1c790956

hameerabbasi force pushed from f5b9f901 to 1c790956 1 year ago

Rebasing derp.

9454e845

Merge branch 'main' into auraflow-lora

5700e527

sayakpaul commented on 2025-01-06

Merge branch 'main' into auraflow-lora

6da81f89

Get more tests passing by copying from Flux. Address review comments.

28a4918a

hameerabbasi force pushed from 6514892f to 28a4918a 1 year ago

`joint_attention_kwargs`->`attention_kwargs`

d6028cdc

Merge branch 'main' into auraflow-lora

6e899a38

Add `lora_scale` property for te LoRAs.

2d02c2c8

Make test better.

2b934b45

Remove useless property.

532013f9

Merge branch 'main' into auraflow-lora

0ea9ecd1

Skip TE-only tests for AuraFlow.

e06d8eb9

Support LoRA for non-CLIP TEs.

2b359094

hameerabbasi force pushed from fab1b427 to be954f4f 1 year ago

hameerabbasi force pushed from be954f4f to b59b25ea 1 year ago

hameerabbasi force pushed from b59b25ea to 00c921e4 1 year ago

Merge remote-tracking branch 'upstream/main' into auraflow-lora

1ec07a1f

hameerabbasi force pushed from 00c921e4 to 1ec07a1f 1 year ago

Merge branch 'main' into auraflow-lora

077a452e

Merge branch 'main' into auraflow-lora

3095644e

hameerabbasi commented on 2025-01-13

Merge remote-tracking branch 'upstream/main' into auraflow-lora

df28362b

Restore LoRA tests.

7e63330e

Undo adding LoRA support for non-CLIP TEs.

5620384d

hameerabbasi force pushed from 9a89ed04 to 5620384d 1 year ago

Undo support for TE in AuraFlow LoRA.

cd691d37

`make fix-copies`

0fa5cd5d

Sync with upstream changes.

83e0825a

Remove unneeded stuff.

12fbd118

hameerabbasi force pushed from 0751c4b4 to 12fbd118 1 year ago

github-actions added stale

Merge branch 'main' into auraflow-lora

c6027490

hameerabbasi requested a review from

sayakpaul 1 year ago

Mirror `Lumina2`.

cdd184d4

hameerabbasi force pushed from 677a1e26 to cdd184d4 1 year ago

Skip for MPS.

ce1939b3

sayakpaul commented on 2025-02-26

hameerabbasi force pushed from bef5ff41 to 1442c491 1 year ago

Address review comments.

3b9e6554

hameerabbasi force pushed from 1442c491 to 3b9e6554 1 year ago

Remove duplicated code.

c11b14d7

hameerabbasi force pushed from c06fcba8 to c11b14d7 1 year ago

Remove unnecessary code.

636f01cd

hameerabbasi force pushed from acb6dcf0 to 636f01cd 1 year ago

Remove repeated docs.

75ba7dac

Propagate attention.

c2daa8a9

Fix TE target modules.

8aa2d690

MPS fix for LoRA tests.

b19942f1

hameerabbasi force pushed from 766b7ada to b19942f1 1 year ago

Unrelated TE LoRA tests fix.

50917570

Fix AuraFlow LoRA tests by applying to the right denoiser layers.

dee9074b

Merge remote-tracking branch 'upstream/main' into auraflow-lora

62411093

hameerabbasi force pushed from 9ef26056 to 62411093 1 year ago

hameerabbasi requested a review from

sayakpaul 1 year ago

hameerabbasi requested a review from

bghira 1 year ago

github-actions removed stale

Merge branch 'main' into auraflow-lora

ed331947

Apply style fixes

65a3bf5f

empty commit

147a3564

Fix the repo consistency issues.

0c91c1a1

sayakpaul approved these changes on 2025-04-08

Remove unrelated changes.

e97a83ea

Style.

a5b78d16

Fix `test_lora_fuse_nan`.

dbc84273

Merge branch 'main' into auraflow-lora

22fc9d9a

sayakpaul commented on 2025-04-08

fix quality issues.

ea14465e

sayakpaul commented on 2025-04-08

hameerabbasi force pushed from 24812f39 to d2ecef4b 1 year ago

`pytest.xfail` -> `ValueError`.

a20d03d9

hameerabbasi force pushed from d2ecef4b to a20d03d9 1 year ago

Add back `skip_mps`.

fb5f5f7f

Merge branch 'main' into auraflow-lora

f88503b8

Apply style fixes

12dc9113

Merge branch 'main' into auraflow-lora

fd9ed521

Merge branch 'main' into auraflow-lora

e418c2ff

sayakpaul closed this 1 year ago

sayakpaul reopened this 1 year ago

Merge remote-tracking branch 'upstream/main' into auraflow-lora

5e537d1f

`make fix-copies`

bc93160b

Merge branch 'main' into auraflow-lora

2880ba40

sayakpaul merged 9352a5ca into main 1 year ago

hameerabbasi deleted the auraflow-lora branch 1 year ago

diffusers
[LoRA] Add LoRA support to AuraFlow
#10216

Merged

[LoRA] Add LoRA support to AuraFlow #10216

diffusers [LoRA] Add LoRA support to AuraFlow #10216 Merged

[LoRA] Add LoRA support to AuraFlow #10216

diffusers
[LoRA] Add LoRA support to AuraFlow
#10216

Merged