Pin transformers in nv-inference (#4606)
nv-inference is failing due to changes on the transformers side. Sample
passing build
[here](https://github.com/microsoft/DeepSpeed/actions/runs/6619077509/job/17978847686#step:5:19)
and sample failing build
[here](https://github.com/microsoft/DeepSpeed/actions/runs/6619077509/job/18349776000#step:5:19)
