transformers
Better imports in continuous_batching for prior version of torch
#46287
Closed
Closed
Better imports in continuous_batching for prior version of torch #46287
SunMarc
wants to merge
3 commits into
main
from
fix-continuous-batching-device-mesh-import
Guard torch.distributed.tensor.device_mesh import in continuous_batching
0201b877
Avoid eager torch.distributed.tensor.device_mesh import in continuous…
c9161099
Merge remote-tracking branch 'origin/fix-continuous-batching-device-m…
638f222f
Login to write a write a comment.
Login via GitHub