vllm
a7e3eba6 - [Frontend] Support reasoning content for deepseek r1 (#12473)

Commit

136 days ago

[Frontend] Support reasoning content for deepseek r1 (#12473) Signed-off-by: Ce Gao <cegao@tensorchord.ai> Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com> Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com> Co-authored-by: Michael Goin <mgoin@redhat.com>

References

#12473 - [Frontend] Support reasoning content for deepseek r1

Author

gaocegege

Parents

fbb5bd4c

Files16

docs/source
- features
  - reasoning_outputs.md
- index.md
examples/online_serving
- openai_chat_completion_with_reasoning.py
- openai_chat_completion_with_reasoning_streaming.py
tests/entrypoints/openai
- reasoning_parsers
  - __init__.py
  - test_deepseekr1_reasoning_parser.py
  - utils.py
- test_cli_args.py
vllm
- entrypoints/openai
  - api_server.py
  - cli_args.py
  - protocol.py
  - reasoning_parsers
    - __init__.py
    - abs_reasoning_parsers.py
    - deepseek_r1_reasoning_parser.py
  - serving_chat.py
- scripts.py

vllm a7e3eba6 - [Frontend] Support reasoning content for deepseek r1 (#12473)

vllm
a7e3eba6 - [Frontend] Support reasoning content for deepseek r1 (#12473)