text-generation-inference
fix(num_devices): fix num_shard/num device auto compute when NVIDIA_VISIBLE_DEVICES == "all" or "void"
#3346
Merged
Merged
fix(num_devices): fix num_shard/num device auto compute when NVIDIA_VISIBLE_DEVICES == "all" or "void" #3346
oOraph
merged
2 commits into
main
from
fix_num_shard_auto_compute
fix(num_devices): fix num_shard/num device auto compute when NVIDIA_V…
1eec0a4d
drbh
dismissed these changes
on 2025-12-18
fix(num_shard): make TGI compliant with nvidia-container-toolkit in c…
60a2a4b2
drbh
approved these changes
on 2025-12-18
oOraph
changed the title 
Login to write a write a comment.
Login via GitHub