vllm
9d3b1404 - [Model Runner V2] Prepare attn metadata in ModelState [2/N]

Commit

55 days ago

[Model Runner V2] Prepare attn metadata in ModelState [2/N] Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

References

Author

WoosukKwon

Parents