vllm
3b30e615 - [NemotronH] Do not force router to run in fp32 (#34582)

Commit

70 days ago

[NemotronH] Do not force router to run in fp32 (#34582) Signed-off-by: Roi Koren <roik@nvidia.com>

References

Author

roikoren755

Parents