PR #1044 Music Spectrogram diffusion pipeline

initial TokenEncoder and ContinuousEncoder

f85d908b

initial modules

e0254102

added ContinuousContextTransformer

e88dc6fe

kashif marked this pull request as draft 3 years ago

Merge branch 'main' into spectrogram-diffusion

c9dd1dde

patrickvonplaten requested a review from

patrickvonplaten 3 years ago

patrickvonplaten requested a review from

anton-l 3 years ago

fix copy paste error

59e2111f

use numpy for get_sequence_length

ab829233

initial terminal relative positional encodings

cdc6ec7e

fix weights keys

c55fb5bb

fix assert

af673745

cross attend style: concat encodings

ef43fe0a

Merge branch 'main' into spectrogram-diffusion

33755df1

make style

6de0cfb1

Merge branch 'main' into spectrogram-diffusion

10682829

concat once

5546c121

fix formatting

8b32df34

Initial SpectrogramPipeline

c69a3b90

fix input_tokens

f7254db3

make style

133d155b

added mel output

aa2323f0

ignore weights for config

c154878f

move mel to numpy

63f69b6c

import pipeline

9808d066

fix class names and import

49d95c0c

moved models to models folder

ce4a6582

import ContinuousContextTransformer and SpectrogramDiffusionPipeline

b3caf357

initial spec diffusion converstion script

593e2aa0

renamed config to t5config

c7077995

patrickvonplaten commented on 2022-11-08

added weight loading

55bb6ddc

use arguments instead of t5config

7cb32d7d

broadcast noise time to batch dim

0251747a

fix call

8a54f88a

added scale_to_features

b6373b89

fix weights

5fb437d9

transpose laynorm weight

5591f21d

scale is a vector

21b7ea22

scale the query outputs

87ee8a34

added comment

6deafab6

undo scaling

8830c2bb

patrickvonplaten commented on 2022-11-17

undo depth_scaling

3b9e822e

inital get_extended_attention_mask

9328701c

attention_mask is none in self-attention

f86a785f

cleanup

9905492a

manually invert attention

f439e5b2

nn.linear need bias=False

dd5dc10e

added T5LayerFFCond

d987df01

kashif marked this pull request as ready for review 3 years ago

remove to fix conflict

428fae94

Merge branch 'main' into spectrogram-diffusion

9b1f8d3f

make style and dummy

670331ee

Merge branch 'main' into spectrogram-diffusion

70c56373

remove unsed variables

f98beebf

remove predict_epsilon

37735c0b

Move accelerate to a soft-dependency (#1134)

f9217a7d

fix order

ff51d45f

added initial midi to note token data pipeline

4a215ddb

added int to int tokenizer

d8544cb5

remove duplicate

5f628432

added logic for segments

505e78a3

add melgan to pipeline

52f7896a

move autoregressive gen into pipeline

1e267765

added note_representation_processor_chain

a643c8b2

fix dtypes

202b8105

remove immutabledict req

085d766a

initial doc

3edc9e19

Merge branch 'main' into spectrogram-diffusion

30259737

use np.where

5472ef57

Merge branch 'main' into spectrogram-diffusion

41e56f0e

require note_seq

87b5914d

fix typo

cf24a459

Merge branch 'main' into spectrogram-diffusion

6d48ef9a

update dependency

00465c4d

added note-seq to test

cd097b48

patrickvonplaten commented on 2022-12-20

added is_note_seq_available

04ac770e

fix import

2afaf276

Merge branch 'main' into spectrogram-diffusion

d4c167cf

Merge branch 'main' into spectrogram-diffusion

8f8371ef

added toc

3acb123a

added example usage

b9d0842a

undo for now

f3b4ad4c

Merge branch 'main' into spectrogram-diffusion

7ab039f9

moved docs

50908b82

Merge branch 'main' into spectrogram-diffusion

79b278dc

fix merge

cfd0c7f1

fix imports

71ed0dc2

Merge branch 'main' into spectrogram-diffusion

43783d10

predict first segment

e4af28e9

avoid un-needed copy to and from cpu

8f74e27a

make style

bbddffa3

Merge branch 'main' into spectrogram-diffusion

da82d61a

Copyright

908d8acc

Merge branch 'main' into spectrogram-diffusion

e3c028d8

Merge branch 'main' into spectrogram-diffusion

92b20baa

fix style

9e57320e

Merge branch 'main' into spectrogram-diffusion

bf2c9f4a

Merge branch 'main' into spectrogram-diffusion

75094780

add test and fix inference steps

e8b73d07

remove bogus files

7dda0594

patrickvonplaten commented on 2023-02-15

reorder models

19e60135

up

0a1b02b7

remove transformers dependency

17d0edff

make work with diffusers cross attention

658080c6

clean more

49fbce7b

remove @

fa2d918c

improve further

dc2a226f

up

f9b96419

uP

1bd68f23

patrickvonplaten commented on 2023-02-15

Merge branch 'main' into spectrogram-diffusion

e58ac329

patrickvonplaten commented on 2023-03-02

Apply suggestions from code review

25cb927d

patrickvonplaten commented on 2023-03-02

Update tests/pipelines/spectrogram_diffusion/test_spectrogram_diffusi…

59101b56

Merge branch 'main' into spectrogram-diffusion

7e0e8ea8

loop over all tokens

bc83fb3e

make style

783f89e3

Added a section on the model

5584ab3c

fix formatting

46ad2c78

grammer

a9cafb7a

formatting

3f1bb133

make fix-copies

ff5e1358

patrickvonplaten commented on 2023-03-07

Update src/diffusers/pipelines/__init__.py

07f5429d

patrickvonplaten commented on 2023-03-07

Update src/diffusers/pipelines/spectrogram_diffusion/pipeline_spectro…

bae1edad

added callback ad optional ionnx

adf1e6e1

do not squeeze batch dim

1e78af98

clean up more

098f1a2d

upload

fa77427b

Merge branch 'main' into spectrogram-diffusion

56b7101e

convert jax to nnumpy

40a7f781

make style

14b19563

fix warning

40e90f08

patrickvonplaten commented on 2023-03-13

Merge branch 'main' into spectrogram-diffusion

a883b3b8

make fix-copies

819705c0

Merge branch 'main' into spectrogram-diffusion

de162e5b

Merge branch 'main' into spectrogram-diffusion

d6285a0c

patrickvonplaten commented on 2023-03-16

fix warning

a2725a20

add initial fast tests

0b850f3a

add initial pipeline_params

d3265914

eval mode due to dropout

dffad61a

skip batch tests as pipeline runs on a single file

78397e49

make style

4908b058

Merge branch 'main' into spectrogram-diffusion

ad0c5000

fix relative path

03c7ae51

fix doc tests

dfb32828

patrickvonplaten commented on 2023-03-21

Update src/diffusers/models/t5_film_transformer.py

2a38f764

patrickvonplaten commented on 2023-03-21

Update src/diffusers/models/t5_film_transformer.py

96111b23

Merge branch 'main' into spectrogram-diffusion

f436adbe

patrickvonplaten commented on 2023-03-21

Update docs/source/en/api/pipelines/spectrogram_diffusion.mdx

17dbe1d2

Update tests/pipelines/spectrogram_diffusion/test_spectrogram_diffusi…

dd9f8ca5

Update tests/pipelines/spectrogram_diffusion/test_spectrogram_diffusi…

654c7966

Update tests/pipelines/spectrogram_diffusion/test_spectrogram_diffusi…

9a8a93dd

patrickvonplaten approved these changes on 2023-03-21

Update tests/pipelines/spectrogram_diffusion/test_spectrogram_diffusi…

ebb8e9a7

add MidiProcessor

3a944769

format

7c43be89

fix org

6dcd3f7a

patrickvonplaten commented on 2023-03-21

Apply suggestions from code review

17b74819

patrickvonplaten commented on 2023-03-21

Update tests/pipelines/spectrogram_diffusion/test_spectrogram_diffusi…

458e7b77

make style

4f27f66e

Merge branch 'main' into spectrogram-diffusion

dc8280e9

pin protobuf to <4

76a28c19

fix formatting

7339d379

white space

f71b1550

tensorboard needs protobuf

e5225a39

Merge branch 'main' into spectrogram-diffusion

8abbd574

patrickvonplaten merged 2ef9bdd7 into main 3 years ago

kashif deleted the spectrogram-diffusion branch 3 years ago

diffusers
Music Spectrogram diffusion pipeline
#1044

Merged

Music Spectrogram diffusion pipeline #1044

diffusers Music Spectrogram diffusion pipeline #1044 Merged

Music Spectrogram diffusion pipeline #1044

diffusers
Music Spectrogram diffusion pipeline
#1044

Merged