vllm
8fb2c135 - [Bugfix] Fix stale SSM state for new Mamba requests scheduled as decode (#32118)

Commit

110 days ago

[Bugfix] Fix stale SSM state for new Mamba requests scheduled as decode (#32118) Signed-off-by: Josephasafg <ajgard7@gmail.com>

References

Author

Josephasafg

Parents