diffusers
983dec3b - [Core] Introduce class variants for `Transformer2DModel` (#7647)

Comment changes are shownComment changes are hidden
Commit
1 year ago
[Core] Introduce class variants for `Transformer2DModel` (#7647) * init for patches * finish patched model. * continuous transformer * vectorized transformer2d. * style. * inits. * fix-copies. * introduce DiTTransformer2DModel. * fixes * use REMAPPING as suggested by @DN6 * better logging. * add pixart transformer model. * inits. * caption_channels. * attention masking. * fix use_additional_conditions. * remove print. * debug * flatten * fix: assertion for sigma * handle remapping for modeling_utils * add tests for dit transformer2d * quality * placeholder for pixart tests * pixart tests * add _no_split_modules * add docs. * check * check * check * check * fix tests * fix tests * move Transformer output to modeling_output * move errors better and bring back use_additional_conditions attribute. * add unnecessary things from DiT. * clean up pixart * fix remapping * fix device_map things in pixart2d. * replace Transformer2DModel with appropriate classes in dit, pixart tests * empty * legacy mixin classes./ * use a remapping dict for fetching class names. * change to specifc model types in the pipeline implementations. * move _fetch_remapped_cls_from_config to modeling_loading_utils.py * fix dependency problems. * add deprecation note.
Author
Parents
  • docs/source/en
    • File
      _toctree.yml
    • api/models
      • File
        dit_transformer2d.md
      • File
        pixart_transformer2d.md
  • src/diffusers
    • File
      __init__.py
    • File
      configuration_utils.py
    • models
      • File
        __init__.py
      • File
        model_loading_utils.py
      • File
        modeling_outputs.py
      • File
        modeling_utils.py
      • transformers
        • File
          __init__.py
        • File
          dit_transformer_2d.py
        • File
          pixart_transformer_2d.py
        • File
          transformer_2d.py
    • pipelines
      • dit
        • File
          pipeline_dit.py
      • File
        pipeline_loading_utils.py
      • pixart_alpha
        • File
          pipeline_pixart_alpha.py
        • File
          pipeline_pixart_sigma.py
    • utils
      • File
        dummy_pt_objects.py
  • tests
    • models
      • File
        test_modeling_common.py
      • transformers
        • File
          test_models_dit_transformer2d.py
        • File
          test_models_pixart_transformer2d.py
    • pipelines
      • dit
        • File
          test_dit.py
      • pixart_alpha
        • File
          test_pixart.py
      • pixart_sigma
        • File
          test_pixart.py