vllm
6fe7401f - [Perf] Read VLLM_COMPUTE_NANS_IN_LOGITS once per IterationStats (#61710)

Commit

10 days ago

[Perf] Read VLLM_COMPUTE_NANS_IN_LOGITS once per IterationStats (#61710) Signed-off-by: Pei Li <peili@nvidia.com> Co-authored-by: Kevin H. Luu <khluu000@gmail.com>

References

#61710 - [Perf] Read VLLM_COMPUTE_NANS_IN_LOGITS once per IterationStats

Author

peilii

Parents

716c5225

vllm 6fe7401f - [Perf] Read VLLM_COMPUTE_NANS_IN_LOGITS once per IterationStats (#61710)

vllm
6fe7401f - [Perf] Read VLLM_COMPUTE_NANS_IN_LOGITS once per IterationStats (#61710)