text-generation-inference

83624a07 - Add possible variants for A100 and H100 GPUs for auto-detecting flops (#2837)

Add possible variants for A100 and H100 GPUs for auto-detecting flops (#2837) * Update main.rs with A100 and H100 variants * Add another variant "nvidia-h100-nvl" * Update main.rs Add nvidia-a100-sxm4-40gb