vllm
[Frontend] Support cache_salt in /v1/completions and /v1/responses
#20981
Merged

[Frontend] Support cache_salt in /v1/completions and /v1/responses #20981

DarkLight1337 merged 3 commits into vllm-project:main from dr75:completions
dr75
dr75 add cache_salt to completion and response requests
eec58f53
dr75 enable prompt_tokens_detail for completions
404a3e5f
dr75 dr75 requested a review from aarnphm aarnphm 290 days ago
github-actions
gemini-code-assist
gemini-code-assist commented on 2025-07-15
mergify mergify added frontend
gemini-code-assist
gemini-code-assist commented on 2025-07-15
dr75 fix unbound variable
b0cc0ac3
DarkLight1337
DarkLight1337 approved these changes on 2025-07-15
DarkLight1337 DarkLight1337 enabled auto-merge (squash) 290 days ago
github-actions github-actions added ready
DarkLight1337 DarkLight1337 changed the title API: support cache_salt in /v1/completions and /v1/responses [Frontend] Support cache_salt in /v1/completions and /v1/responses 290 days ago
disabled auto-merge 290 days ago
Manually disabled by user
DarkLight1337 DarkLight1337 enabled auto-merge (squash) 290 days ago
DarkLight1337 DarkLight1337 merged 19c86306 into main 289 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone