vllm
ebb12a48
- Merge branch 'main' into woosuk/mrv2-model-states
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
13 hours ago
Merge branch 'main' into woosuk/mrv2-model-states Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
References
#35350 - [Model Runner V2] Add model states [1/N]
#35383 - [Model Runner V2] Prepare attn metadata in ModelState [2/N]
Author
WoosukKwon
Parents
a687aa15
86c3b5a8
Loading