Add Musicgen #24109
sanchit-gandhi
merged
154 commits into
huggingface:main
from
sanchit-gandhi:audiocraft
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
patrickvonplaten
commented
on 2023-06-16
sanchit-gandhi
commented
on 2023-06-19
sanchit-gandhi
commented
on 2023-06-19
sanchit-gandhi
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
patrickvonplaten
commented
on 2023-06-19
Add Audiocraft
ced7cb5f
add cross attention
55821f78
style
55a21f52
add for lm
56cfadbf
convert and verify
8a9ddbf1
introduce t5
9e70dfb0
split configs
aa648467
load t5 + lm
9ec9c372
clean conversion
06e35386
copy from t5
5a6b390b
style
79c3f0e8
start pattern provider
2a2b6e38
make generation work
2a168672
style
07668b6b
fix pos embs
5db67b62
propagate shape changes
8cdf4969
propagate shape changes
a7b0c758
style
d84e1a56
delay pattern: pad tokens at end
04c1e491
audiocraft -> musicgen
c7a78335
fix inits
aab9c0a6
add mdx
0575c8c6
style
7fec1a24
fix pad token in processor
20e16823
override generate and add todos
526a99de
add init to test
a3811e72
undo pattern delay mask after gen
b8e313b8
remove cfg logits processor
414b3d15
remove cfg logits processor
94dea27a
remove logits processor in favour of mask
04f8d58a
clean pos embs
1a22c70b
make fix copies
1fe75b26
update readmes
06ceac7f
clean pos emb
1e4d56d9
refactor encoder/decoder
9b7e66e9
make fix copies
e900cc30
update conversion
df6e9117
fix config imports
30684aea
update config docs
f4344ec3
make style
e7a740f0
send pattern mask to device
358e611f
pattern mask with delay
e9a3739a
recover prompted audio tokens
bd330e73
fix docstrings
3eb434ca
laydown test file
e837fe93
pattern edge case
0ee70a29
remove t5 ref
e29b7a13
add processing class
d75cbd4f
config refactor
75088f62
better pattern comment
faf84a2e
check if mask is not present
7a8a03a7
check if mask is not present
8e62225a
refactor to auto class
bfbf3252
remove encoder configs
7d0562c4
fix processor
a17ca0c1
processor import
4c560428
start updating conversion
583d994d
start updating tests
f20b6545
make style
2ae374d6
convert t5, encodec, lm
c74afc67
convert as composite
d710b736
also convert processor
8f8aa332
run generate
acb3b726
classifier free gen
368a8a6b
comments and clean up
aaeeff76
make style
89f061ab
docs for logit proc
fab79227
refactor: reshape inside forward
34b52c94
undo greedy loop changes
242b2bce
from_enc_dec -> from_sub_model
293f44bb
fix input id shapes in docstrings
ccd3a997
Apply suggestions from code review
7d6ea11b
undo generate changes
b8d09cb2
from sub model config
84da8acd
Update src/transformers/models/musicgen/modeling_musicgen.py
6a76bb93
make generate work again
da611d06
generate uncond -> get uncond inputs
251a1b54
remove prefix allowed tokens fn
5f78277e
better error message
3b246c14
logit proc checks
7d26e3e1
Apply suggestions from code review
f7dd1c12
make decoder only tests work
fe7d7b44
composite fast tests
445698c7
make style
0cfe68f8
uncond generation
eb49e4a0
feat extr padding
35c1f36b
make audio prompt work
9f2a030a
fix inputs docstrings
15cff552
unconditional inputs: dict -> model output
db2b3b60
clean up tests
0e73197a
more clean up tests
2a783de3
make style
8fed510e
t5 encoder -> auto text encoder
00640ee8
remove comments
f1e51ba8
deal with frames
938e7c1e
fix auto text
8475bb61
slow tests
727d30b2
nice mdx
81521421
remove can generate
1e99722a
todo - hub id
e232053b
convert m/l
feabb255
make fix copies
f5ebc62a
only import generation with torch
c905bf02
ignore decoder from tests
9115d0c5
don't wrap uncond inputs
2be768c2
make style
cb0273db
cleaner uncond inputs
857e2c0e
add example to musicgen forward
637960e1
fix docs
d7f45382
ignore MusicGen Model/ForConditionalGeneration in auto mapping
53de80fc
add doc section to toctree
6ac1ec80
add to doc tests
1a52522b
add processor tests
2f450dc6
fix push to hub in conversion
5a01be46
tips for decoder only loading
2a93c32f
Apply suggestions from code review
04c19d31
fix conversion for s / m / l checkpoints
f8fc3aec
Merge remote-tracking branch 'origin/audiocraft' into audiocraft
4ea636c7
import stopping criteria from module
a1bf8b03
remove from pipeline tests
e5607b84
fix uncond docstring
92682231
decode audio method
928813d4
fix docs
48e044f2
org: sanchit-gandhi -> facebook
829f7242
fix max pos embeddings
082257bf
remove auto doc (not compatible with shapes)
523dd4a1
bump max pos emb
59fb3c12
make style
11e62dae
fix doc
f57b1147
fix config doc
eb6eb3d6
fix config doc
90917c3b
ignore musicgen config from docstring
2e1ac257
make style
89ef58de
fix config
dbd6c4d6
fix config for doctest
7a477576
consistent from_sub_models
0e86fcd7
don't automap decoder
789fd4d3
Merge branch 'main' into audiocraft
20f3c35e
sanchit-gandhi
commented
on 2023-06-27
fix mdx save audio file
5132a88b
fix mdx save audio file
0788d33a
processor batch decode for audio
c0235d32
remove keys to ignore
1e4b914a
update doc md
27af227b
update generation config
edb461e8
allow changes for default generation config
af2e3b24
update tests
028b8ef2
make style
1913771c
fix docstring for uncond
aa1eccdd
fix processor test
c1a64ac1
fix processor test
e87842e8
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub