DeepSpeed
74b6f763 - Merge branch 'master' into staging-inference-v2-5

Comment changes are shownComment changes are hidden
Commit
1 year ago
Merge branch 'master' into staging-inference-v2-5
Author
  • .github/workflows
    • File
      cpu-inference.yml
  • File
    README.md
  • csrc/deepspeed4science/evoformer_attn
    • File
      attention_cu.cu
  • deepspeed
    • checkpoint
      • File
        constants.py
      • File
        ds_to_universal.py
    • module_inject
      • File
        auto_tp.py
      • File
        auto_tp_model_utils.py
      • File
        fusedqkv_utils.py
      • File
        layers.py
      • File
        replace_module.py
      • File
        tp_shard.py
    • runtime
      • File
        config.py
      • File
        constants.py
      • File
        engine.py
      • pipe
        • File
          engine.py
        • File
          module.py
      • zero
        • File
          stage3.py
        • File
          stage_1_and_2.py
  • docs
    • assets/files
      • File
        zeroquant_series.pdf
    • code-docs/source
      • File
        model-checkpointing.rst
    • File
      index.md
  • op_builder
    • File
      builder.py
    • File
      evoformer_attn.py
  • tests/unit/inference
    • File
      test_inference.py