DeepSpeed
2777c23e - added perf test and fix for gpt-j-6B OOM on V100 16GB

Commit

3 years ago

added perf test and fix for gpt-j-6B OOM on V100 16GB

References

#1992 - [inference] test suite for ds-kernels (bert, roberta, gpt2, gpt-neo, gpt-j)

Author

mrwyattii

mrwyattii

Parents

Files1

tests/unit
- test_inference.py