llama.cpp
Deepseek V3.1 native tool calling support (OpenAI Style)
#15533
Merged
Overview
Commits
60
Changes
View On GitHub

Deepseek V3.1 native tool calling support (OpenAI Style) #15533

CISC merged 60 commits into ggml-org:master from createthis:deepseek_3_1_thinking_mode
createthis
openhands-agent Add DeepSeek V3.1 thinking mode support
0d96944f
createthis Another attempt by V3.1 non-thinking
3912fd30
createthis Fix test, but it's not asserting anything.
bac6c99c
createthis Ignore vim swap files in tests dir
fe86282e
createthis Update the test
3d00d625
createthis Try using try_find_literal instead of regex
c50d887e
createthis passing test
3f319aa8
createthis Revert "Try using try_find_literal instead of regex"
79f7ca3e
createthis Remove unnecessary change
0d959ba8
createthis Remove comment
6223c1cb
createthis Add code to handle non-thinking mode.
0d372f45
createthis Try to set message['prefix'] when thinking is enabled.
f0da1164
createthis This fixes reasoning, but breaks normal content. We need state in the
56f7e388
createthis DeepSeek V3.1 thinking is now the default. Disable with `--reasoning-…
f4f0ddb8
github-actions github-actions added testing
createthis Simplify (DeepSeek V3.1 reasoning)
f7d2ee9c
CISC
CISC commented on 2025-08-24
createthis Fix sign inversion bug
7ac92ca8
createthis createthis requested a review from ngxson ngxson 117 days ago
github-actions github-actions added examples
github-actions github-actions added server
createthis createthis marked this pull request as draft 116 days ago
createthis Add some tool calling code (not working).
be0b2b8c
createthis Tool calls working in non-reasoning mode.
776d95b2
createthis createthis marked this pull request as ready for review 116 days ago
createthis Attempt a unit test for tool call parsing.
a32cad15
createthis Passing test
52d54886
createthis Add tests for both happy path and broken fenced DeepSeek V3.1 tool ca…
a839be7c
createthis Passing DeepSeek V3.1 tool call tests, but model is not working.
6ade60ec
createthis Revert assistance response prefill change. Not my monkeys.
79d4812f
createthis Add fenced_thinking unit test variant. Passes, but thinking tool calling
36b047cf
createthis Tests pass in reasoning mode. Also e2e tool test passes.
bdfa87f7
createthis Make a copy of the parse_json_tool_calls function for deepseek-v3.1 so
0e367617
createthis Merge pull request #7 from createthis/deepseek_3_1_thinking_mode_danger
4cb47f31
createthis Fix thinking_forced_open logic. tool calling broken. Need to add another
ab22c767
createthis That's what I get for cargo culting a newline.
4a2d17d9
createthis Add multi tool call test for deepseek v3.1 non-reasoning
b2d57cef
createthis Merge branch 'master' into deepseek_3_1_thinking_mode
f422fe70
createthis createthis requested a review from CISC CISC 112 days ago
createthis Move test, remove .gitignore change
7dc19e83
CISC
createthis Place deepseek-v3.1 reasoning test directly into existing reasoning
380146e6
createthis Address whitespace CI failure.
90567071
createthis
CISC
CISC commented on 2025-08-29
CISC
CISC commented on 2025-08-29
createthis Merge two assert_equals per CISC's request.
a406d6a2
createthis Add DeepSeek-V3.1 tests to tests/test-chat.cpp per CISC's request.
ec984da1
createthis createthis requested a review from CISC CISC 111 days ago
createthis Merge branch 'master' into deepseek_3_1_thinking_mode
92003d7a
createthis Merge deepseek V3.1 and regular parse_json_tool_calls() function
f661dbe3
CISC
CISC requested changes on 2025-08-31
createthis Update tests/test-chat-parser.cpp
12b013f7
createthis Update tests/test-chat-parser.cpp
800af009
createthis Update tests/test-chat-parser.cpp
80a7e1c4
createthis Update tests/test-chat-parser.cpp
155852a6
createthis Update tests/test-chat-parser.cpp
e5878081
createthis Update tests/test-chat-parser.cpp
ac6ed1e0
createthis Update tests/test-chat-parser.cpp
3843d94d
createthis Update tests/test-chat-parser.cpp
67737082
createthis Update tests/test-chat-parser.cpp
befa31c6
CISC
CISC commented on 2025-08-31
createthis DeepSeek V3.1 fix reasoning_format none
77955943
createthis createthis requested a review from CISC CISC 108 days ago
createthis Merge branch 'master' into deepseek_3_1_thinking_mode
3dee75a1
createthis Strip grammar down to strictly what we expect based on model card. Throw
a7316b06
createthis Merge pull request #8 from createthis/deepseek_3_1_thinking_mode_expe…
707cde18
createthis
CISC
CISC approved these changes on 2025-09-04
createthis Update tests/test-chat-parser.cpp
e3fe1ce0
createthis Merge branch 'master' into deepseek_3_1_thinking_mode
25034ebd
createthis
ggerganov
createthis
pwilkin
createthis createthis marked this pull request as draft 105 days ago
createthis DeepSeek V3.1 - Add edge case where thinking is forced open, there is
9830e7e3
createthis
createthis createthis marked this pull request as ready for review 104 days ago
createthis
createthis Merge branch 'master' into deepseek_3_1_thinking_mode
91bc6157
createthis DeepSeek V3.1 - simplify update_cursor
26b02fa8
createthis
createthis createthis changed the title Deepseek V3.1 thinking mode is the default Deepseek V3.1 tool calling support 102 days ago
createthis createthis changed the title Deepseek V3.1 tool calling support Deepseek V3.1 native tool calling support (OpenAI Style) 102 days ago
CISC
CISC approved these changes on 2025-09-08
createthis Update common/chat.cpp
3ccc6519
createthis Update common/chat.cpp
e23eedd1
createthis Update common/chat.cpp
cf17a8e3
createthis Fix indent
4c2179d2
CISC CISC merged 88021565 into master 102 days ago
createthis
fernandaspets
createthis

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
testing examples server
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum