DeepSpeed
367d6f9c - Support InternLM (#4137)

Comment changes are shownComment changes are hidden
Commit
1 year ago
Support InternLM (#4137) * correct inference with some debug codes. * remove prints * update transformer import set_qkv and format * support some lora abstract method * fix attn_ob * some debug * leave orig layer set by user * remove debugs * move attn ob to mlp module * move import transformer * init orig class only once * remove copyright --------- Co-authored-by: Lev Kurilenko <113481193+lekurile@users.noreply.github.com>
Author
Parents
  • deepspeed
    • module_inject
      • containers
        • File
          __init__.py
        • File
          internlm.py
      • File
        replace_policy.py
      • File
        utils.py
    • ops/transformer/inference
      • File
        ds_attention.py
      • op_binding
        • File
          mlp_gemm.py
        • File
          qkv_gemm.py