vllm

[Bug] Fix torch dynamo warning Dynamo detected a call to a `functools.lru_cache`

#29038

Merged