vllm
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint
#9837
Merged
Merged
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint #9837
simon-mo
merged
7 commits into
vllm-project:main
from
gcalmettes:feat/support-max-completion-tokens
DarkLight1337
commented
on 2024-10-30
DarkLight1337
approved these changes
on 2024-10-30
mgoin
commented
on 2024-10-30
disabled auto-merge 1 year ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
feat(openai): add new field max_completion_tokens
389fd9ec
feat: use new max_completion_tokens field for chat_completions calls
c5371927
lint: apply formatting
acac1426
feat: bump openai dependency to version introducing max_completion_to…
cf5041b9
lint: apply yapf
b1621bfe
chore: reflect max_completion_tokens support for minimal openai lib v…
520be809
feat: tie TODO comments to relevant issue for better referencing
aad5b19e
Reviewers
Assignees
Labels
documentation
frontend
ready
ci/build
Milestone
No milestone
Login to write a write a comment.
Login via GitHub