vllm
feat - add a new endpoint `get_tokenizer_info` to provide tokenizer/chat-template information
#20575
Merged
Merged
feat - add a new endpoint `get_tokenizer_info` to provide tokenizer/chat-template information #20575
DarkLight1337
merged
11 commits into
vllm-project:main
from
m-misiura:feat_get_tokenizer_info_endpoint
:sparkles: added a new endpoint to extract tokenizer and chat templat…
e2efa8f3
gemini-code-assist
commented
on 2025-07-07
DarkLight1337
commented
on 2025-07-07
:construction: made the get_tokenizer_info opt-in; disable unless a f…
ade71671
DarkLight1337
commented
on 2025-07-08
DarkLight1337
commented
on 2025-07-08
:construction: renamed endpoint from `get_tokenizer_info` to `tokeniz…
855b7bf3
DarkLight1337
commented
on 2025-07-09
:art: formatting changes
8ff1d1b0
DarkLight1337
commented
on 2025-07-09
:recycle: `TokenizerInfo` is now a dataclass to reduce boiler plate
167fd626
DarkLight1337
commented
on 2025-07-09
:construction: simplifying tokenizer_class extraction
3b2ea85a
DarkLight1337
commented
on 2025-07-09
:construction: move ConfigDict to top of TokenizerInfoResponse as cla…
0e0c04e2
DarkLight1337
commented
on 2025-07-10
:recycle: make config more pythonic
8eb54614
DarkLight1337
approved these changes
on 2025-07-10
:construction: updated test_tokenization tests to reflect that `token…
a42e7e9b
Merge remote-tracking branch 'upstream/main' into feat_get_tokenizer_…
14a42ac0
disabled auto-merge 191 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
:construction: added the cli arg for the tokenizer info endpoint
a69b7054
Assignees
No one assigned
Labels
frontend
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub