ochafik/llama.cpp

Pull Requests Commits

fix trigger of thinking models (must happen after thoughts are closed)

Olivier Chafik committed 1 year ago

eaeed7da

server: wire chat diffs in stream mode

ochafik committed 1 year ago

6ed8a8ff

refactor parser w/ optionals

ochafik committed 1 year ago

94623655

partial common_chat_parse

Olivier Chafik committed 1 year ago

cd3681dc

add common_chat_msg_diff

ochafik committed 1 year ago

ce2f593b

renaming: string_find_partial_stop (moved to common.cpp)

ochafik committed 1 year ago

a95fe780

add common_json w/ support for truncated json healing

ochafik committed 1 year ago

6dcff433

add common_regex w/ support for partial final matches

ochafik committed 1 year ago

16c9c633

tests : fix test-quantize-fns to init the CPU backend (#12306)

ggerganov committed 1 year ago

Verified e128a1bf

common : refactor '-o' option (#12278)

marcoStocchi committed 1 year ago

Verified 6ef79a67

`server`: extract <think> tags from qwq outputs (#12297)

ochafik committed 1 year ago

Verified 4e39a3c3

`tool-call`: ensure there's always a non-empty tool call id (#12292)

ochafik committed 1 year ago

Verified be421fc4

allow missing content in message if tool_calls provided (#12293)

ochafik committed 1 year ago

Verified 87c26305

`sampler`: fixes trigger tokens + lazy grammars (fix typo cast from token to string) (#12291)

ochafik committed 1 year ago

Verified 2b3a25c2

llava : fix bug in minicpm-v code (#11513)

tc-mb committed 1 year ago

Verified 8352cdc8

server : add speculative decoding presets for FIM (#12287)

ggerganov committed 1 year ago

Verified 1e2f78a0

authors : update (#12271)

ggerganov committed 1 year ago

Verified 0fd7ca7a

ggml-backend : make path_str compatible with C++20 (#12269)

ctrysbita committed 1 year ago

Verified 6fefc05a

server : infill gen ends on new line (#12254)

ggerganov committed 1 year ago

Verified 7ab36439

ggml : skip intermediate .air file when compiling .metallib (#12247)

danbev committed 1 year ago

Verified 7c7f3b7f

ggerganov committed 1 year ago

102ac189

ggml : ggml_compute_forward_concat() for arbitrary tensor type (ggml/1118)

vmobilis committed 1 year ago

d6ae2fa0

ggml-cpu: faster AVX2 variant for IQ1_M (#12216)

remyoudompheng committed 1 year ago

Verified 68d0027f

ci : fix save-load test invocations (#12245)

ggerganov committed 1 year ago

Verified ea002810

server : Log original chat template parsing error (#12233)

CISC committed 1 year ago

Verified 8fad3c7a

sync: minja - support QwQ-32B (#12235)

ochafik committed 1 year ago

Verified 7cf64f6b

metal : simplify kernel arguments using a struct (#3229) (#12194)

BB-fat committed 1 year ago

Verified 5e2d57b2

HIP: fix rocWMMA build flags under Windows (#12230)

hjc4869 committed 1 year ago

Verified f1648e91

metal : fix default.metallib build (#12224)

danbev committed 1 year ago

Verified d6c95b07

opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (#12217)

lhez committed 1 year ago

Verified d76a86d9

Older