DeepSpeed
[INF] Add Qwen2RMSNorm to loaded layers in auto_tp
#5786
Merged

Commits
  • [INF] Add Qwen2RMSNorm to loaded layers in auto_tp
    oelayan7 committed 1 year ago
  • Merge branch 'master' into qwen_rms
    loadams committed 1 year ago
Loading