PR #5827 Add ControlNet-XS support

Check in 23-10-05

7ce3745a

check-in 23-10-06

70d58d90

check-in 23-10-07 2pm

762bdfd8

check-in 23-10-08

267ca004

check-in 231009T1200

53564781

check-in 230109

b30120c7

checkin 231010

7b67ceb9

init + forward run

f4d8d629

checkin

9c175491

checkin

cc40b55b

ControlNetXSModel is now saveable+loadable

95b7425d

Forward works

0e7c848e

checkin

969e7e89

Pipeline works with `no_control=True`

111fa2d9

Merge branch 'huggingface:main' into controlnet-xs

34b7dbbf

checkin

6270bc05

Merge branch 'controlnet-xs' of https://github.com/UmerHA/diffusers i…

7ae8a46e

debug: save intermediate outputs of resnet

92673881

checkin

8bcb3d04

Understood time error + fixed connection error

a52e605c

checkin

b408dbc6

checkin 231106T1600

e0ad61bd

turned off detailled debug prints

d76881af

time debug logs

202d3def

small fix

8996cf4c

Separated control_scale for connections/time

f54ac820

simplified debug logging

7654c326

Full denoising works with control scale = 0

cc1a7065

aligned logs

05f99269

Added control_attention_head_dim param

34ecd9a5

Passing n_heads instead of dim_head into ctrl unet

c975ea85

Fixed ctrl midblock bug

535149d3

Cleanup

1583c13d

Fixed time dtype bug

73a7b99a

checkin

e20d4b58

1. from_unet, 2. base passed, 3. all unet params

56e9b59d

checkin

2cc2cfb5

Finished docstrings

0bb94578

cleanup

39257c59

make style

e4f412e1

Merge remote-tracking branch 'upstream/main' into controlnet-xs

031aab36

checkin

e032fa08

more tests pass

e543a545

Fixed tests

6945de8a

removed debug logs

1a0c4ad2

make style + quality

7cc437e3

make fix-copies

0f655bbd

fixed documentation

cf0b6d5f

added cnxs to doc toc

3cb6d32e

added control start/end param

f11e0e73

Update controlnetxs_sdxl.md

7b05af47

tried to fix copies..

5f99f798

Fixed norm_num_groups in from_unet

85dc4851

added sdxl-depth test

c76eb352

created SD2.1 controlnet-xs pipeline

08668ae3

Merge branch 'huggingface:main' into controlnet-xs

c9d7e7db

re-added debug logs

ad1f39f7

Merge branch 'main' into controlnet-xs

76e9b964

Adjusting group norm ; readded logs

37cbe6c9

Added debug log statements

d2c2635d

removed debug logs ; started tests for sd2.1

f7941134

updated sd21 tests

e6de144c

fixed tests

0ba4b032

fixed tests

412c772f

slightly increased error tolerance for 1 test

3776ce71

Merge branch 'main' into controlnet-xs

6897ea97

make style & quality

17a12ce4

Added docs for CNXS-SD

a884e877

make fix-copies

e6dc4730

Fixed sd compile test ; fixed gradient ckpointing

b5982735

vae downs = cnxs conditioning downs; removed guess

b75e6233

make style & quality

0f2a05f9

Fixed tests

f59231c5

fixed test

165a3588

Merge branch 'main' into controlnet-xs

84164840

UmerHA marked this pull request as ready for review 1 year ago

patrickvonplaten commented on 2023-11-29

patrickvonplaten requested a review from

yiyixuxu 1 year ago

patrickvonplaten requested a review from

sayakpaul 1 year ago

sayakpaul commented on 2023-11-30

sayakpaul approved these changes on 2023-11-30

Incorporated review feedback

a2d5a52c

simplified control model surgery

a5d94d7d

fixed tests & make style / quality

87a32546

Updated docs; deleted pip & cursor files

d8e723be

Rolled back minimal change to resnet

7b006467

Update resnet.py

d8cc418a

Update resnet.py

aacf54e6

Merge branch 'main' into controlnet-xs

d05be07d

sayakpaul commented on 2023-12-01

sayakpaul approved these changes on 2023-12-01

sayakpaul requested a review from

DN6 1 year ago

sayakpaul requested a review from

stevhliu 1 year ago

sayakpaul commented on 2023-12-01

patrickvonplaten commented on 2023-12-01

Update src/diffusers/models/controlnetxs.py

5997cf9f

Update src/diffusers/models/controlnetxs.py

40e099a9

Dao007forever commented on 2023-12-03

Incorporated review feedback

b789646a

Merge branch 'main' into controlnet-xs

a3bd017c

stevhliu approved these changes on 2023-12-04

Update docs/source/en/api/pipelines/controlnetxs_sdxl.md

06bfe12c

Update docs/source/en/api/pipelines/controlnetxs.md

4e9448aa

Update docs/source/en/api/pipelines/controlnetxs.md

348bedba

Update docs/source/en/api/pipelines/controlnetxs.md

167b7674

Update src/diffusers/models/controlnetxs.py

40744c9e

Update src/diffusers/models/controlnetxs.py

bab91cbb

Update src/diffusers/pipelines/controlnet_xs/pipeline_controlnet_xs.py

bf976d0e

Update docs/source/en/api/pipelines/controlnetxs.md

dfa97f08

Update src/diffusers/pipelines/controlnet_xs/pipeline_controlnet_xs_s…

eb8dd2b9

Incorporated doc feedback

58ea5abe

Merge branch 'main' into controlnet-xs

7e35ccff

DN6 approved these changes on 2023-12-05

Merge branch 'main' into controlnet-xs

51e4fdda

Merge branch 'main' into controlnet-xs

83a2b11e

patrickvonplaten merged e192ae08 into main 1 year ago

UmerHA deleted the controlnet-xs branch 1 year ago

patrickvonplaten commented on 2023-12-27

diffusers
Add ControlNet-XS support
#5827

Merged

Add ControlNet-XS support #5827

diffusers Add ControlNet-XS support #5827 Merged

Add ControlNet-XS support #5827

diffusers
Add ControlNet-XS support
#5827

Merged