ochafik/llama.cpp

Pull Requests Commits

json: refine constraint for whitespace to avoid runaways yet allow pretty print

ochafik committed 1 year ago

ddc16b8d

`json`: document schema conversion in GBNF readme, align manual grammar examples & converters (#7841)

ochafik committed 1 year ago

Verified 396b18df

cmake : fix CMake requirement for CUDA (#7821)

cebtenzzre committed 1 year ago

Verified 864a99e7

ci : try win-2019 on server windows test (#7854)

slaren committed 1 year ago

Verified fd5ea0f8

examples : remove --instruct remnants (#7846)

ggerganov committed 1 year ago

Verified c28a8390

server : improve "prompt" handling (#7847)

ggerganov committed 1 year ago

Verified d9da0e49

CUDA: use tensor cores for MMQ (#7676)

JohannesGaessler committed 1 year ago

Verified 1f0dabda

use the correct SYCL context for host USM allocations (#7777)

bashbaug committed 1 year ago

Verified af4ae502

flake.lock: Update (#7838)

ggerganov committed 1 year ago

Verified 10ceba35

imatrix : handle partial entries (#7833)

ggerganov committed 1 year ago

Verified e95beeb1

docs: Added initial PR template with directions for doc only changes and squash merges [no ci] (#7700)

nicolasperez19 committed 1 year ago

Verified 57bf62ce

server: do not remove whitespace at the start of a completion chunk (#7830)

mgroeber9110 committed 1 year ago

Verified 3e2ee443

CUDA: revise q8_1 data layout for mul_mat_q (#7824)

JohannesGaessler committed 1 year ago

Verified 42b53d19

convert-hf : set the model name based on cli arg, if present (#7693)

sasha0552 committed 1 year ago

Verified 2decf57b

convert-hf : match model part name prefix and suffix (#7687)

compilade committed 1 year ago

Verified 5795b941

gguf-py : decouple adding metadata from writing in GGUFWriter (#7827)

compilade committed 1 year ago

Verified ed9f2521

Revert "[SYCL] Update rpc-server.cpp to include SYCL backend (#7682)" (#7808)

slaren committed 1 year ago

Verified fe1e3917

url: save -mu downloads to new cache location (#7826)

ochafik committed 1 year ago

Verified d4d915d3

server : smart slot selection using Longest Common Prefix (#7728)

sasha0552 committed 1 year ago

Verified 7a16ce7d

vulkan : reuse parent extra for views (#7806)

slaren committed 1 year ago

Verified da799b41

gguf-split : change binary multi-byte units to decimal (#7803)

christianazinn committed 1 year ago

Verified c00fad71

cmake : fix BUILD_SHARED_LIBS=ON build (#7784)

intelmatt committed 1 year ago

Verified 27615f5a

server: update cache_prompt documentation [no ci] (#7745)

JohannesGaessler committed 1 year ago

Verified 7027b27d

server : do not get prompt in infill mode (#7286)

woodx9 committed 1 year ago

Verified a5cabd76

[SYCL] fix softmax r2r result wrong issue (#7811)

pengxin99 committed 1 year ago

Verified d5c938cd

check for nans in imatrix and quantize (#7807)

slaren committed 1 year ago

Verified c9ee7118

server : fix --threads-http arg (#7801)

ggerganov committed 1 year ago

Verified ee459f40

imatrix : migrate to gpt_params (#7771)

ggerganov committed 1 year ago

Verified f83351f9

Added support for . (any character) token in grammar engine. (#6467)

HanClinto committed 1 year ago

Verified ad675e1c

README minor fixes (#7798) [no ci]

mattchediak committed 1 year ago

Verified a143c043

Older