vllm
e42c230e - [Bugfix] serving_llama70B_tp4 benchmark was silently running at tensor_parallel_size=1 (#50766)

Commit
20 days ago
[Bugfix] serving_llama70B_tp4 benchmark was silently running at tensor_parallel_size=1 (#50766) Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com> Co-authored-by: Claude <noreply@anthropic.com>
Author
Parents
Loading