vllm
911355e2 - [ROCm] Fix KV copy methods and auto-select attention backend for ROCm (#36845)

Commit

18 hours ago

[ROCm] Fix KV copy methods and auto-select attention backend for ROCm (#36845) Signed-off-by: Andreas Karatzas <akaratza@amd.com>

References

Author

AndreasKaratzas

Parents