llama.cpp
Support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client
#13196
Merged

Support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client #13196

CISC merged 16 commits into ggml-org:master from matteoserva:enable_thinking
matteoserva
matteoserva matteoserva requested a review from ngxson ngxson 1 year ago
matteoserva matteoserva marked this pull request as draft 1 year ago
github-actions github-actions added examples
github-actions github-actions added server
matteoserva matteoserva force pushed 1 year ago
rhjdvsgsgks
matteoserva
matteoserva matteoserva force pushed 1 year ago
matteoserva matteoserva force pushed 1 year ago
matteoserva matteoserva changed the title [RFC] handling jinja extra template kwargs (Qwen3 enable_thinking feature) Support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client 1 year ago
matteoserva matteoserva marked this pull request as ready for review 1 year ago
neolee
matteoserva matteoserva force pushed 1 year ago
xiaomi102
celsowm
matteoserva
xiaomi102
matteoserva
matteoserva matteoserva force pushed 1 year ago
matteoserva matteoserva force pushed 1 year ago
celsowm
strawberrymelonpanda
neolee
ggerganov
ggerganov commented on 2025-05-16
ggerganov ggerganov requested a review from ochafik ochafik 1 year ago
matteoserva matteoserva requested a review from ggerganov ggerganov 1 year ago
Neath
taha-yassine
ochafik
ochafik commented on 2025-05-16
neolee
matteoserva
matteoserva matteoserva force pushed to dbbe6e4f 1 year ago
matteoserva matteoserva force pushed from dbbe6e4f 1 year ago
matteoserva matteoserva force pushed 1 year ago
ochafik
matteoserva
matteoserva matteoserva force pushed 1 year ago
aviallon
ochafik
ochafik requested changes on 2025-05-26
matteoserva matteoserva force pushed 1 year ago
matteoserva matteoserva marked this pull request as draft 1 year ago
matteoserva matteoserva force pushed 1 year ago
matteoserva matteoserva marked this pull request as ready for review 1 year ago
matteoserva matteoserva requested a review from ochafik ochafik 1 year ago
matteoserva
qinxuye
matteoserva matteoserva force pushed 1 year ago
ochafik
ochafik approved these changes on 2025-06-03
exxocism
aviallon
zghnwsq
squirrelfish
aviallon
matteoserva
matteoserva initial commit for handling extra template kwargs
2950f624
matteoserva enable_thinking and assistant prefill cannot be enabled at the same time
46064b49
matteoserva can set chat_template_kwargs in command line
91681d45
matteoserva added doc
a92e790b
matteoserva fixed formatting
abda1aed
matteoserva add support for extra context in generic template init
570018b1
matteoserva coding standard: common/chat.cpp
8c8b2903
matteoserva coding standard: common/chat.cpp
56b3a691
matteoserva Apply suggestions from code review
fe6e44ad
matteoserva fix merge conflict
67789ef0
ochafik chat.cpp: simplify calls to apply to ensure systematic propagation of…
9a938632
matteoserva normalize environment variable name
74f6060c
matteoserva simplify code
cdc3cbe0
matteoserva prefill cannot be used with thinking models
226e37d8
matteoserva compatibility with the new reasoning-budget parameter
4e1c329d
exxocism
exxocism commented on 2025-06-08
matteoserva fix prefill for non thinking models
a056e536
matteoserva matteoserva force pushed to a056e536 364 days ago
rasbid
aviallon
ggerganov
exxocism
exxocism commented on 2025-06-14
CISC CISC merged caf5681f into master 343 days ago
matteoserva matteoserva deleted the enable_thinking branch 343 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone