DeepSpeed
9063a948 - added an assertion for moded-parallel support and added code to protect WORLD_SIZE computation

Commit

3 years ago

added an assertion for moded-parallel support and added code to protect WORLD_SIZE computation

References

Author

Arpan Jain

Parents