text-generation-inference
0204946d - Max token capacity metric (#2595)

Commit
1 year ago
Max token capacity metric (#2595) * adding max_token_capacity_metric * added tgi to name of metric * Adding max capacity metric. * Add description for the metrics --------- Co-authored-by: Edwinhr716 <Edandres249@gmail.com>
Author
Parents
Loading