ochafik/llama.cpp

Pull Requests Commits

tool-call: fix functionary v3.1 required test

ochafik committed 1 year ago

f7078cab

reshuffle chat handlers

ochafik committed 1 year ago

5ec4c5e4

ochafik committed 1 year ago

43385b2f

Merge branch 'tool-call' into tool-call-handler

ochafik committed 1 year ago

11594557

nit: trailing spaces

ochafik committed 1 year ago

3f3fc039

Update test_chat_completion.py

Olivier Chafik committed 1 year ago

51b7aab8

jinja: don't add bos when jinja enabled

Olivier Chafik committed 1 year ago

a6463c1e

Update test_chat_completion.py

Olivier Chafik committed 1 year ago

0208b207

tool-call: allow special tokens that are grammar triggers

Olivier Chafik committed 1 year ago

c479d39a

WIP chat handlers

Olivier Chafik committed 1 year ago

36ed106f

Fix lazy trigger handling

Olivier Chafik committed 1 year ago

46415d7a

Update real tool call tests (use less models)

Olivier Chafik committed 1 year ago

c2d836f9

Add grammar options + rename builder to common_grammar_builder

Olivier Chafik committed 1 year ago

a46de6a0

Update chat-template.hpp

Olivier Chafik committed 1 year ago

cdfa8b9d

fix msg init warning

Olivier Chafik committed 1 year ago

5e358ade

fix common_chat_msg invocations

Olivier Chafik committed 1 year ago

f0231a58

Merge remote-tracking branch 'origin/master' into tool-call

Olivier Chafik committed 1 year ago

d186721e

`minja`: sync at https://github.com/google/minja/commit/0f5f7f2b3770eb682fbc11763266d45204173686 (#11352)

ochafik committed 1 year ago

Verified c64d2bec

Sync minja after https://github.com/google/minja/pull/29

Olivier Chafik committed 1 year ago

9ccc62b3

Adding logprobs to /v1/completions (#11344)

jpodivin committed 1 year ago

Verified 96f40539

Update test_chat_completion.py

Olivier Chafik committed 1 year ago

30d33d9f

Greedy sampling in tool call tests

Olivier Chafik committed 1 year ago

c6a22edc

Update tool-call.cpp

Olivier Chafik committed 1 year ago

cce1166b

Olivier Chafik committed 1 year ago

a4226365

Olivier Chafik committed 1 year ago

63387c6d

merge common_tool_calls into common_chat_msg

Olivier Chafik committed 1 year ago

82b6e9a5

Merge remote-tracking branch 'origin/master' into tool-call

Olivier Chafik committed 1 year ago

01b345be

`common`: utils to split / join / repeat strings (from json converter) (#11342)

ochafik committed 1 year ago

Verified a94f3b27

llava : support Minicpm-omni (#11289)

tc-mb committed 1 year ago

Verified 3e3357fd

Olivier Chafik committed 1 year ago

2dd09c79

Older