vllm
feaf202e - [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348)

Commit

144 days ago

[Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348) Signed-off-by: Remy <eunhwan.shin@dtonic.io> Co-authored-by: Li, Jiang <jiang1.li@intel.com>

References

#24348 - [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319)

Author

comsky

Parents

91130ae3

vllm feaf202e - [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348)

vllm
feaf202e - [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348)