vllm
a09ad90a - [V1] guidance backend for structured output + `auto` fallback mode (#14779)

Commit

110 days ago

[V1] guidance backend for structured output + `auto` fallback mode (#14779) Signed-off-by: Russell Bryant <rbryant@redhat.com> Co-authored-by: Loc Huynh <jc1da.3011@gmail.com> Co-authored-by: Michal Moskal <michal@moskal.me>

References

#14779 - [V1] guidance backend for structured output + `auto` fallback mode

Author

russellb

Parents

10b34e36

Files9

requirements
- common.txt
tests/v1/entrypoints/llm
- test_struct_output_generate.py
vllm
- config.py
- engine
  - arg_utils.py
- v1
  - engine
    - processor.py
  - structured_output
    - __init__.py
    - backend_guidance.py
    - request.py
    - utils.py

vllm a09ad90a - [V1] guidance backend for structured output + `auto` fallback mode (#14779)

vllm
a09ad90a - [V1] guidance backend for structured output + `auto` fallback mode (#14779)