text-generation-inference
Add possible variants for A100 and H100 GPUs for auto-detecting flops
#2837

Merged

Add possible variants for A100 and H100 GPUs for auto-detecting flops #2837

danieldk merged 3 commits into huggingface:main from lazariv:main

Update main.rs with A100 and H100 variants

3da49f3f

Add another variant "nvidia-h100-nvl"

985bd6ac

Update main.rs

6516a5c0

danieldk approved these changes on 2025-01-10

danieldk merged 83624a07 into main 345 days ago

Reviewers

danieldk

Assignees

No one assigned

Labels

None yet

Milestone

No milestone