vllm
43936849 - [BugFix] Fix PP/async scheduling with pooling models (#28899)

Commit

22 days ago

[BugFix] Fix PP/async scheduling with pooling models (#28899) Signed-off-by: Nick Hill <nhill@redhat.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

References

releases/v0.11.1

#28899 - [BugFix] Fix PP/async scheduling with pooling models

Author

njhill

Parents

896e41ae

vllm 43936849 - [BugFix] Fix PP/async scheduling with pooling models (#28899)

vllm
43936849 - [BugFix] Fix PP/async scheduling with pooling models (#28899)