ochafik/llama.cpp

Pull Requests Commits

draft install.sh

Olivier Chafik committed 1 year ago

12cc4833

`tool-call`: command r7b fix for normal responses (#11608)

ochafik committed 1 year ago

Verified db288b60

readme : add llm_client Rust crate to readme bindings (#11628)

ShelbyJenkins committed 1 year ago

Verified 106045e7

swift : fix llama-vocab api usage (#11645)

jhen0409 committed 1 year ago

Verified f117d84b

metal : use residency set for other platforms (#11648)

jhen0409 committed 1 year ago

Verified 534c46b5

authors : update

ggerganov committed 1 year ago

Verified 387a1598

ggerganov committed 1 year ago

Verified 7c9e0ca5

cmake: Add ability to pass in GGML_BUILD_NUMBER (ggml/1096)

ckastner committed 1 year ago

Verified 8f8290ad

ci : do not stale-close roadmap issues

ggerganov committed 1 year ago

Verified b34aedd5

`tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon parsing issue, avoid double bos (#11616)

ochafik committed 1 year ago

Verified cde38332

server : (webui) revert hacky solution from #11626 (#11634)

ngxson committed 1 year ago

Verified b3451785

server : (webui) allow typing and submitting during llm response (#11626)

woof-dog committed 1 year ago

Verified 1d1e6a90

server : remove CPPHTTPLIB_NO_EXCEPTIONS define (#11622)

danbev committed 1 year ago

Verified 5598f475

ggerganov committed 1 year ago

Verified 8ec05832

CUDA: fix Volta FlashAttention logic (#11615)

JohannesGaessler committed 1 year ago

Verified 21c84b5d

server : (webui) Fix Shift+Enter handling (#11609)

mashdragon committed 1 year ago

Verified d92cb67e

HIP: fix flash_attn_stream_k_fixup warning (#11604)

JohannesGaessler committed 1 year ago

Verified 6eecde3c

CUDA/HIP: add support for selectable warp size to mmv (#11519)

IMbackK committed 1 year ago

Verified 396856b4

HIP: add GGML_CUDA_CC_IS_* for amd familys as increasing cc archtectures for amd gpus are not supersets of eatch other (#11601)

IMbackK committed 1 year ago

Verified 4d0598e1

nit: more informative crash when grammar sampler fails (#11593)

ochafik committed 1 year ago

Verified 90f9b88a

CUDA: use mma PTX instructions for FlashAttention (#11583)

JohannesGaessler committed 1 year ago

Verified 864a0b67

Name colors (#11573)

ericcurtin committed 1 year ago

Verified 84ec8a58

`tool-call`: support Command R7B (+ return tool_plan "thoughts" in API) (#11585)

ochafik committed 1 year ago

Verified bfcce4d6

Fix exotic ci env that lacks ostringstream::str (#11581)

ochafik committed 1 year ago

Verified 69804487

sampling : support for llguidance grammars (#10224)

mmoskal committed 1 year ago

Verified ff227703

llama : add support for GLM-Edge and GLM-Edge-V series models (#10573)

piDack committed 1 year ago

Verified 0cec062a

ci: use sccache on windows HIP jobs (#11553)

ochafik committed 1 year ago

Verified 53debe6f

`sync`: minja (https://github.com/google/minja/commit/418a2364b56dc9be4ed9a1a2b0fb16fb53a7a22e) (#11574)

ochafik committed 1 year ago

Verified cfd74c86

Implement s3:// protocol (#11511)

ericcurtin committed 1 year ago

Verified ecef206c

ci: simplify cmake build commands (#11548)

ochafik committed 1 year ago

Verified 5bbc7362

Older