DeepSpeed
2df486c7 - add falcon-180b support

Commit
1 year ago
add falcon-180b support
Author
Reza Yazdani
Parents
  • csrc/transformer/inference
    • csrc
      • File
        apply_rotary_pos_emb.cu
      • File
        pt_binding.cpp
      • File
        transform.cu
    • includes
      • File
        inference_cuda_layers.h
  • deepspeed
    • module_inject/containers
      • File
        falcon.py
    • ops/transformer/inference
      • File
        ds_attention.py
      • File
        ds_mlp.py
      • op_binding
        • File
          mlp_gemm.py
        • File
          softmax_context.py