ochafik/llama.cpp

Pull Requests Commits

Simplify code / rely on template

ochafik committed 1 year ago

7e3eae78

Fix typo in lazy grammar handling (fixes trigger tokens)

ochafik committed 1 year ago

c74226e6

Just in case, add more special tokens to preserve

ochafik committed 1 year ago

82c258f5

Allow content in parse_json_tool_calls

ochafik committed 1 year ago

7fc54f5a

Simplify phi-4 parser (use parse_json_tool_calls)

ochafik committed 1 year ago

582420ee

Fix phi-4 grammar (needs <|tool_call|> wrappers)

ochafik committed 1 year ago

aa5694f8

Create llama-cpp-microsoft-Phi-4-mini-instruct.jinja

ochafik committed 1 year ago

4de63f33

`tool-call`: Phi-4 support

jpohhhh committed 1 year ago

769cd716

server : add speculative decoding presets for FIM (#12287)

ggerganov committed 1 year ago

Verified 1e2f78a0

authors : update (#12271)

ggerganov committed 1 year ago

Verified 0fd7ca7a

ggml-backend : make path_str compatible with C++20 (#12269)

ctrysbita committed 1 year ago

Verified 6fefc05a

server : infill gen ends on new line (#12254)

ggerganov committed 1 year ago

Verified 7ab36439

ggml : skip intermediate .air file when compiling .metallib (#12247)

danbev committed 1 year ago

Verified 7c7f3b7f

ggerganov committed 1 year ago

102ac189

ggml : ggml_compute_forward_concat() for arbitrary tensor type (ggml/1118)

vmobilis committed 1 year ago

d6ae2fa0

ggml-cpu: faster AVX2 variant for IQ1_M (#12216)

remyoudompheng committed 1 year ago

Verified 68d0027f

ci : fix save-load test invocations (#12245)

ggerganov committed 1 year ago

Verified ea002810

server : Log original chat template parsing error (#12233)

CISC committed 1 year ago

Verified 8fad3c7a

sync: minja - support QwQ-32B (#12235)

ochafik committed 1 year ago

Verified 7cf64f6b

metal : simplify kernel arguments using a struct (#3229) (#12194)

BB-fat committed 1 year ago

Verified 5e2d57b2

HIP: fix rocWMMA build flags under Windows (#12230)

hjc4869 committed 1 year ago

Verified f1648e91

metal : fix default.metallib build (#12224)

danbev committed 1 year ago

Verified d6c95b07

opencl: Noncontiguous `norm`, `rms_norm`, disable `fp16` for some ops (#12217)

lhez committed 1 year ago

Verified d76a86d9

cmake : fix undefined reference errors for std::filesystem in ggml (#12092) (#12094)

hbuxiaofei committed 1 year ago

Verified 776f9e59

readme : update bindings (#12229)

lmbelo committed 1 year ago

Verified 3d652bfd

CUDA: fix FA logic for PTX 7.0 and CC >= 7.5 (#12222)

JohannesGaessler committed 1 year ago

Verified 5220a16d

HIP: rocWMMA documentation and enabling in workflow builds (#12179)

hjc4869 committed 1 year ago

Verified 3ffbbd5c

update function-calling.md w/ template override for functionary-small-v3.2 (#12214)

ochafik committed 1 year ago

Verified 42994048

llava: add big-endian conversion for image encoder (#12218)

taronaeo committed 1 year ago

Verified e9b2f84f

HIP/CUDA: set the paramerter value in maintain_cuda_graph instead of replaceing it. (#12209)

IMbackK committed 1 year ago

Verified e721c05c

Older