transformers
c43b380e - Add MusicGen Melody (#28819)

Commit
1 year ago
Add MusicGen Melody (#28819) * first modeling code * make repository * still WIP * update model * add tests * add latest change * clean docstrings and copied from * update docstrings md and readme * correct chroma function * correct copied from and remove unreleated test * add doc to toctree * correct imports * add convert script to notdoctested * Add suggestion from Sanchit Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com> * correct get_uncoditional_inputs docstrings * modify README according to SANCHIT feedback * add chroma to audio utils * clean librosa and torchaudio hard dependencies * fix FE * refactor audio decoder -> audio encoder for consistency with previous musicgen * refactor conditional -> encoder * modify sampling rate logics * modify license at the beginning * refactor all_self_attns->all_attentions * remove ignore copy from causallm generate * add copied from for from_sub_models * fix make copies * add warning if audio is truncated * add copied from where relevant * remove artefact * fix convert script * fix torchaudio and FE * modify chroma method according to feedback-> better naming * refactor input_values->input_features * refactor input_values->input_features and fix import fe * add input_features to docstrigs * correct inputs_embeds logics * remove dtype conversion * refactor _prepare_conditional_hidden_states_kwargs_for_generation ->_prepare_encoder_hidden_states_kwargs_for_generation * change warning for chroma length * Update src/transformers/models/musicgen_melody/convert_musicgen_melody_transformers.py Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com> * change way to save wav, using soundfile * correct docs and change to soundfile * fix import * fix init proj layers * remove line breaks from md * fix issue with docstrings * add FE suggestions * improve is in logics and remove useless imports * remove custom from_pretrained * simplify docstring code * add suggestions for modeling tests * make style * update converting script with sanity check * remove encoder attention mask from conditional generation * replace musicgen melody checkpoints with official orga * rename ylacombe->facebook in checkpoints * fix copies * remove unecessary warning * add shape in code docstrings * add files to slow doc tests * fix md bug and add md to not_tested * make fix-copies * fix hidden states test and batching --------- Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com>
Author
Parents
  • File
    README.md
  • File
    README_de.md
  • File
    README_es.md
  • File
    README_fr.md
  • File
    README_hd.md
  • File
    README_ja.md
  • File
    README_ko.md
  • File
    README_pt-br.md
  • File
    README_ru.md
  • File
    README_te.md
  • File
    README_vi.md
  • File
    README_zh-hans.md
  • File
    README_zh-hant.md
  • docs/source/en
    • File
      _toctree.yml
    • File
      index.md
    • model_doc
      • File
        musicgen_melody.md
    • tasks
      • File
        language_modeling.md
  • src/transformers
    • File
      __init__.py
    • File
      audio_utils.py
    • models
      • File
        __init__.py
      • auto
        • File
          configuration_auto.py
        • File
          modeling_auto.py
        • File
          tokenization_auto.py
      • musicgen_melody
        • File
          __init__.py
        • File
          configuration_musicgen_melody.py
        • File
          convert_musicgen_melody_transformers.py
        • File
          feature_extraction_musicgen_melody.py
        • File
          modeling_musicgen_melody.py
        • File
          processing_musicgen_melody.py
    • utils
      • File
        dummy_pt_objects.py
      • File
        dummy_torchaudio_objects.py
  • tests
    • models/musicgen_melody
      • File
        __init__.py
      • File
        test_feature_extraction_musicgen_melody.py
      • File
        test_modeling_musicgen_melody.py
      • File
        test_processor_musicgen_melody.py
    • utils
      • File
        test_audio_utils.py
  • utils
    • File
      check_docstrings.py
    • File
      check_repo.py
    • File
      not_doctested.txt
    • File
      slow_documentation_tests.txt