DeepSpeed
a691ec60 - Add tensor parallel inference unit tests (#2232)

Commit

2 years ago

Add tensor parallel inference unit tests (#2232) Co-authored-by: Reza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com> Co-authored-by: Jeff Rasley <jerasley@microsoft.com> Co-authored-by: Sam Ade Jacobs <samjacobs@microsoft.com>

References

guanhua/quant-dequant-test

#2232 - Add tensor parallel inference unit tests

Author

mrwyattii

Parents

d0dfe38d

Files12

.github/workflows
- amd.yml
- nv-accelerate-v100.yml
- nv-inference.yml
- nv-lightning-v100.yml
- nv-nightly.yml
- nv-torch-latest-v100.yml
- nv-torch-nightly-v100.yml
- nv-torch12-p40.yml
- nv-torch18-v100.yml
- nv-transformers-v100.yml
tests
- pytest.ini
- unit/inference
  - test_inference.py

DeepSpeed a691ec60 - Add tensor parallel inference unit tests (#2232)

DeepSpeed
a691ec60 - Add tensor parallel inference unit tests (#2232)