text-generation-inference

6c715f81 - [Bug Fix] Update torch import reference in bnb quantization (#1902)

[Bug Fix] Update torch import reference in bnb quantization (#1902) # What does this PR do? Fixes `Import Error` occurring from mismatch of usage between torch.nn.Module and nn.Module.