DeepSpeed
3d93c078 - avoid CUDA init when getting GPU memory

Commit

3 years ago

avoid CUDA init when getting GPU memory

References

#1992 - [inference] test suite for ds-kernels (bert, roberta, gpt2, gpt-neo, gpt-j)

Author

mrwyattii

mrwyattii

Parents

Files2

requirements
- requirements-dev.txt
tests/unit
- test_inference.py

Loading