llama.cpp
chat : refactor API
#30210
Merged

Commits
  • chat : detect template kind and run the differential analysis once at init
    aldehir committed 14 days ago
  • server,chat : implement chat session type
    aldehir committed 14 days ago
  • server: move vocab to first parameter in chat params parse
    aldehir committed 14 days ago
  • server : remove optional chat session
    aldehir committed 14 days ago
  • chat : start a chat session with the assistant role
    aldehir committed 14 days ago
  • tests : drive the test-chat streaming cases through common_chat_session
    aldehir committed 14 days ago
  • chat : do not copy the parser arena on every parse
    aldehir committed 14 days ago
  • tests : compare tool call arguments before renormalizing them in test-chat
    aldehir committed 14 days ago
  • tests : use one peg_tester per template in test-chat
    aldehir committed 14 days ago
  • tests : stream test-chat cases in simple_tokenize pieces instead of per codepoint
    aldehir committed 14 days ago
  • chat : hold the template analysis in a unique_ptr
    aldehir committed 14 days ago
  • chat : assign parsers to data.parser directly
    aldehir committed 14 days ago
  • tests : define simple_tokenize in test-chat
    aldehir committed 14 days ago
  • chat,server : resolve chat sampling in the session and stop exposing internal chat fields
    aldehir committed 14 days ago
  • cont : cleanup
    aldehir committed 14 days ago
  • cont : cleanup
    aldehir committed 14 days ago
  • tests : defer test-chat speedups
    aldehir committed 14 days ago
  • tests : check the session prompt by substring
    aldehir committed 14 days ago
  • cont : clean up
    aldehir committed 14 days ago
  • common : remove peg parser serialization
    aldehir committed 14 days ago
  • cont : clean up
    aldehir committed 14 days ago
Loading