ochafik/llama.cpp

Pull Requests Commits

fix common_json_parse

ochafik committed 1 year ago

ade759b4

Update json-partial.cpp

ochafik committed 1 year ago

30ef002d

update partial parsing

ochafik committed 1 year ago

db9b7f37

Update chat.cpp

ochafik committed 1 year ago

82a9dd18

Update test-chat.cpp

ochafik committed 1 year ago

b65e7256

Merge remote-tracking branch 'origin/master' into tool-diffs

ochafik committed 1 year ago

3cb4ee0b

tests : fix test-quantize-fns to init the CPU backend (#12306)

ggerganov committed 1 year ago

Verified e128a1bf

common : refactor '-o' option (#12278)

marcoStocchi committed 1 year ago

Verified 6ef79a67

`server`: extract <think> tags from qwq outputs (#12297)

ochafik committed 1 year ago

Verified 4e39a3c3

`tool-call`: ensure there's always a non-empty tool call id (#12292)

ochafik committed 1 year ago

Verified be421fc4

allow missing content in message if tool_calls provided (#12293)

ochafik committed 1 year ago

Verified 87c26305

`sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string) (#12291)

ochafik committed 1 year ago

Verified 2b3a25c2

llava : fix bug in minicpm-v code (#11513)

tc-mb committed 1 year ago

Verified 8352cdc8

Update chat.cpp

ochafik committed 1 year ago

693c7cd1

TEMP start common_regex transition

ochafik committed 1 year ago

a43072b3

ochafik committed 1 year ago

2b9000a9

Update server.cpp

ochafik committed 1 year ago

0445d45e

Update utils.py

ochafik committed 1 year ago

fda98b06

Update chat.cpp

ochafik committed 1 year ago

ac9ed8f7

fix generic parsing

ochafik committed 1 year ago

33abb389

Merge branch 'allow-nocontent-if-toolcalls' into tool-diffs

ochafik committed 1 year ago

d5502af3

Merge branch 'non-empty-tool-call-id' into tool-diffs

ochafik committed 1 year ago

0e8df870

Merge branch 'fix-trig-tok' into tool-diffs

ochafik committed 1 year ago

e422941c

test for non-empty id in test_tool_call.py

ochafik committed 1 year ago

ee0f3663

allow missing content in message if tool_calls provided

ochafik committed 1 year ago

8584aeed

Ensure there's a non empty tool call id

ochafik committed 1 year ago

a117630b

Fix typo in lazy grammar handling (fixes trigger tokens)

ochafik committed 1 year ago

cb794527

prepare collect_stream in utils.py

ochafik committed 1 year ago

c47e4864

server : add speculative decoding presets for FIM (#12287)

ggerganov committed 1 year ago

Verified 1e2f78a0

update server_slot::reset

ochafik committed 1 year ago

8570f851

Newer Older