DeepSpeed
830d0c0a - [INF] Add Qwen2RMSNorm to loaded layers in auto_tp (#5786)

Commit

1 year ago

[INF] Add Qwen2RMSNorm to loaded layers in auto_tp (#5786) Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>

References

Author

oelayan7

Parents