vllm
faa02757 - [V1] Optimize the overhead of rewinding (#14905)

Commit

1 year ago

[V1] Optimize the overhead of rewinding (#14905) Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

References

Author

WoosukKwon

Parents