ggml-org/llama.cpp

Pull Requests Commits

llama : add missing enum keyword in function signatures (#2610)

cztomsik committed 2 years ago

Verified 348acf18

CUDA: launch_bounds, small q4_K, q5_K mmq refactor (#2596)

JohannesGaessler committed 2 years ago

Verified 1cd06fa2

server : fix default grammar by use empty string in the UI (#2604)

jhen0409 committed 2 years ago

Verified 2feb8934

server : implement json-schema-to-grammar.mjs & add grammar param in the UI (#2588)

jhen0409 committed 2 years ago

Verified 5517d6e6

Enhance Windows 7 and below compatibility. (#2592)

vxiiduu committed 2 years ago

Verified f31b5397

test : add simple grammar parsing tests (#2594)

drbh committed 2 years ago

Verified ee77efea

CUDA: Fixed OpenLLaMA 3b mmq, reduced compile time (#2590)

JohannesGaessler committed 2 years ago

Verified f64d44a9

Adding support for llama2.c models (#2559)

byte-6174 committed 2 years ago

Verified b19edd54

server: fixed wrong variable name in timing json (#2579)

Equim-chan committed 2 years ago

Verified 53dc3994

Handle `ENABLE_VIRTUAL_TERMINAL_PROCESSING` more gracefully on earlier versions of Windows.

DannyDaemonic committed 2 years ago

Verified 9ca4abed

Add --n-predict -2 for stopping generation on full context (#2565)

crasm committed 2 years ago

Verified e59fcb2b

Fix grammar-based sampling issue in server (#2566)

krasserm committed 2 years ago

Verified 16387577

ggml-alloc: Don't try to re-use buffers of external tensors (#2562)

smspillaz committed 2 years ago

Verified 916a9acd

add log_callback to llama_context_params for custom logging. (#2234)

grahameth committed 2 years ago

Verified ea04a4ca

CUDA: tuned mul_mat_q kernels (#2546)

JohannesGaessler committed 2 years ago

Verified 25d43e0e

Allow passing grammar to completion endpoint (#2532)

krasserm committed 2 years ago

Verified f5bfea05

CUDA: tighter VRAM scratch size for 65b/70b (#2551)

JohannesGaessler committed 2 years ago

Verified acfc5478

llm.vim : multiline autocompletion, get rid of "^@" (#2543)

chaihahaha committed 2 years ago

Verified 7ed8d1fe

vim : bring back simple llm.vim example

ggerganov committed 2 years ago

Verified e7f94d6f

vim : streaming and more (#2495)

AustinMroz committed 2 years ago

Verified 2d7baaf5

Add --rope-scale parameter (#2544)

klosax committed 2 years ago

Verified f3c3b4b1

ggml : mul mat tweaks (#2372)

ggerganov committed 2 years ago

Verified 93356bdb

ggml : pad result of ggml_nbytes()

ggerganov committed 2 years ago

Verified 60baff7c

ggml : change params pointer (style change) (#2539)

ggerganov committed 2 years ago

Verified 9082b5df

ggml : sync (custom ops) (#2537)

ggerganov committed 2 years ago

Verified 99d29c00

Fixed mmap prefetch for GPU offloading (#2529)

JohannesGaessler committed 2 years ago

Verified 3d9a5518

metal : fix out-of-bounds access + inc concurrency nodes (#2416)

ggerganov committed 2 years ago

Verified f6f9896a

[Makefile] Move ARM CFLAGS before compilation (#2536)

GiviMAD committed 2 years ago

Verified 34a14b28

[Zig] Rewrite build for Zig 0.11 (#2514)

SlyEcho committed 2 years ago

Verified 7297128d

console : fix issue related to Windows 11 PowerShell console mode persistence (#2521)

DannyDaemonic committed 2 years ago

Verified 86c32198

Newer Older