PR #7847 [Pipeline] Marigold depth and normals estimation

implement marigold depth and normals pipelines in diffusers core

32d5131f

sayakpaul requested a review from

yiyixuxu 2 years ago

sayakpaul requested a review from

sayakpaul 2 years ago

sayakpaul commented on 2024-05-03

yiyixuxu commented on 2024-05-03

remove bibtex

23255c2f

Merge branch 'main' into pipeline_marigold_pr

59ec93b1

remove deprecations

4bde96cc

remove save_memory argument

f12d94cb

remove validate_vae

bf877895

remove config output

bce8dd68

remove batch_size autodetection

b2990115

remove presets logic

e9d6bdfa

remove no_grad

9750185c

add fp16 to the example usage

ef881c65

implement is_matplotlib_available

c1c7520f

move colormap, visualize_depth, and visualize_normals into export_uti…

04c807d7

make the denoising loop more lucid

3de290f3

style

a013e2fb

yiyixuxu commented on 2024-05-12

Merge branch 'main' into pipeline_marigold_pr

142df365

rename denoising_steps into num_inference_steps

2e7e747f

rename input_image into image

405feb31

rename input_latent into latents

b72334b5

remove decode_image

0878b3ef

move clean_latent outside of progress_bar

601bfc8b

refactor marigold-reusable image processing bits into MarigoldImagePr…

a21da454

sayakpaul commented on 2024-05-14

yiyixuxu commented on 2024-05-14

Merge branch 'main' into pipeline_marigold_pr

6b48618f

clean up the usage example docstring

5847bbd0

make ensemble functions members of the pipelines

a1fd5515

add early checks in check_inputs

6f17e2cc

fix vae_scale_factor computation

832cbd85

better compatibility with torch.compile

c4ff406a

move export_depth_to_png to export_utils

f3ae063f

remove encode_prediction

706ff6d1

improve visualize_depth and visualize_normals to accept multi-dimensi…

b699d76a

do not shortcut vae.config variables

c72c5b7f

change all asserts to raise ValueError

0d09a0cc

rename output_prediction_type to output_type

b597ee89

better variable names

91cba308

better variable names

99213c36

pass desc and leave kwargs into the diffusers progress_bar

bca2571b

implement scale_invariant and shift_invariant flags in the ensemble_d…

30a15fa5

fix generator device placement checks

2b276f6c

move encode_empty_text body into the pipeline call

d8a2550a

minor empty text encoding simplifications

24ff8964

adjust pipelines' class docstrings to explain the added construction …

d9f9ca58

improve the scipy failure condition

ee56c355

make input image values range check configurable in the preprocessor

1b2c027c

remove forgotten print

a06bf1f5

add prediction_type model config

2b3261ee

add uncertainty visualization into export utils

0627efc0

change default of output_uncertainty to False

7c16b078

Merge branch 'main' into pipeline_marigold_pr

9767ddd3

yiyixuxu commented on 2024-05-20

fix `output_uncertainty=False`

6e6e1326

remove kwargs

3634eb06

rename prepare_latent into prepare_latents as in other pipelines

f4813c70

move nested-capable `progress_bar` method into the pipelines

566e8949

minor message improvement

b1a151ed

fix cpu offloading

03eb96e7

yiyixuxu commented on 2024-05-20

move colormap, visualize_depth, export_depth_to_16bit_png, visualize_…

f4845bad

fix missing comma

b5052e36

change torch.FloatTensor to torch.Tensor

0f308bbc

fix importing of MarigoldImageProcessor

9db8c177

fix vae offloading

c56d2fa1

yiyixuxu commented on 2024-05-21

implement marigold's intial tests

f5cfeafa

fix num_images computation

662e1d5a

remove MarigoldImageProcessor and outputs from import structure

f03e27d1

update docstrings

6507f1b5

yiyixuxu commented on 2024-05-21

yiyixuxu commented on 2024-05-23

update init

596ada31

update

1b89bf66

style

9814973d

fix

f2a74acb

fix

b35c6ef9

up

412aafc0

up

64978027

up

a4d321c1

add simple test

a778f4d8

up

d0da66c6

update expected np input/output to be channel last

107c1da0

move expand_tensor_or_array into the MarigoldImageProcessor

2345f6e5

rewrite tests to follow conventions - hardcoded slices instead of ima…

b3f3c88f

Merge branch 'main' into pipeline_marigold_pr

80dcdf57

add basic docs.

16e07a14

add anton's contribution statement

4aa8ce54

Merge branch 'main' into pipeline_marigold_pr

0b495c1a

remove todos.

a2df838d

fix assertion values for marigold depth slow tests

00082c89

fix assertion values for depth normals.

09276fbf

remove print

c044f2e1

Merge branch 'main' into pipeline_marigold_pr

699976cb

support AutoencoderTiny in the pipelines

b0fc7f36

update documentation page

10fc97dc

fix missing import in docstring

6e053b40

[doc] add marigold to pipelines overview

56f7980d

[doc] add section "usage examples"

2cbe30b5

fix an issue with latents check in the pipelines

35925b96

add "Frame-by-frame Video Processing with Consistency" section

f808e880

grammarly

183327a5

replace tables with images with css-styled images (blindly)

4b286f85

Merge branch 'main' into pipeline_marigold_pr

59fe25cb

sayakpaul commented on 2024-05-27

style

c587f5d1

print

9dc2f317

fix the assertions.

304ab64f

Merge branch 'main' into pipeline_marigold_pr

ab8d5cef

take from the github runner.

04941312

take the slices from action artifacts

bfaf0023

style.

ad3e4844

update with the slices from the runner.

cab05075

remove unnecessary code blocks.

427637cb

Merge branch 'main' into pipeline_marigold_pr

037fa29c

Revert "[doc] add marigold to pipelines overview"

2da329e7

remove invitation for new modalities

bdd21be2

split out marigold usage examples

38157781

sayakpaul commented on 2024-05-27

sayakpaul approved these changes on 2024-05-27

doc cleanup

20b08ba6

Merge branch 'main' into pipeline_marigold_pr

8aae163e

sayakpaul merged b3d10d6d into main 2 years ago

diffusers
[Pipeline] Marigold depth and normals estimation
#7847

Merged

[Pipeline] Marigold depth and normals estimation #7847

diffusers [Pipeline] Marigold depth and normals estimation #7847 Merged

[Pipeline] Marigold depth and normals estimation #7847

diffusers
[Pipeline] Marigold depth and normals estimation
#7847

Merged