vllm
ec38a736 - [Model Runner V2] Use packed mask for prompt bin counts (#29756)

Commit

32 days ago

[Model Runner V2] Use packed mask for prompt bin counts (#29756) Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

References

Author

WoosukKwon

Parents