vllm
7cc302dd - [kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853)

Commit

27 days ago

[kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853) Signed-off-by: Or Ozeri <oro@il.ibm.com>

References

Author

orozery

Parents