auto-round
30258de7 - honor detected model type for use_vllm_loading, harden vLLM fallback for object inputs, and add vLLM utils unit tests

Commit

25 days ago

honor detected model type for use_vllm_loading, harden vLLM fallback for object inputs, and add vLLM utils unit tests Signed-off-by: changwangss <chang1.wang@intel.com>

Author

changwangss

Parents

b4a86eb2

auto-round 30258de7 - honor detected model type for use_vllm_loading, harden vLLM fallback for object inputs, and add vLLM utils unit tests

auto-round
30258de7 - honor detected model type for use_vllm_loading, harden vLLM fallback for object inputs, and add vLLM utils unit tests