vllm
79acf804 - Fast decode prepare path for prepare_inputs logic

Commit

224 days ago

Fast decode prepare path for prepare_inputs logic Signed-off-by: Alexander Matveev <alexm@neuralmagic.com>

References

low_latency_opt

Author

alexm-redhat

alexm-redhat

Committer

alexm-redhat

alexm-redhat

Parents

Loading