ngxson/llama.cpp

Pull Requests Commits

clean up, no more chatml fallback

ngxson committed 43 days ago

242b5940

use meta whenever possible

ngxson committed 44 days ago

bccb4000

move chat format into CLI

ngxson committed 44 days ago

4b2b29bd

server_chat_params

ngxson committed 44 days ago

0571e75a

model-conversion : add BUILD_DIR variable to run-converted-model scripts (#18927)

danbev committed 44 days ago

Verified 3d55846a

llama : Extend fallback, fix fileno for dio file, exclude case that mmap uses dio file (#18887)

JTischbein committed 45 days ago

Verified 287a3301

docs: add linux to index (#18907)

alosslessdev committed 45 days ago

Verified 293a1565

tests : add test-jinja -py option for cross-checking (#18906)

ngxson committed 45 days ago

Verified fe44d355

jinja : fix object item order (and properly implement dictsort) (#18904)

CISC committed 45 days ago

Verified bbcdac01

jinja : attribute support for join, map and sort (#18883)

CISC committed 45 days ago

Verified d03c45c9

jinja : add missing tojson filter for bool (#18900)

CISC committed 45 days ago

Verified 10c98cbd

jinja : fix lexing of float literals with sign (#18901)

CISC committed 45 days ago

Verified 420960ab

jinja: correct member access rule (#18905)

ngxson committed 45 days ago

Verified f55b033a

opencl: fix q6_K mv for m=1 (#18893)

lhez committed 45 days ago

Verified d1b4757d

ci : add label for jinja changes (#18903)

CISC committed 46 days ago

Verified 57c0beae

kv-cache : optimize KQ mask construction (#18842)

ggerganov committed 46 days ago

Verified 2fbde785

ggml webgpu: support for backend sampling (#18880)

reeselevine committed 46 days ago

Verified a89002f0

ggml : extend ggml_pool_1d + metal (#16429)

ThoreKoritzius committed 47 days ago

Verified 388ce822

docs : update ops.md for CANN backend (#18654)

hipudding committed 47 days ago

Verified 6ba6a3c7

ggml-blas: hide warnings from included BLAS headers (#18818)

DaAwesomeP committed 47 days ago

Verified 0802d4cf

mtmd : Fix ASR for LFM2.5-Audio-1.5B (#18876)

tdakhran committed 47 days ago

Verified c945aaae

common : implement new jinja template engine (#18462)

ngxson committed 47 days ago

Verified c15395f7

Setting mmap and direct_io to false as default in llama-bench.cpp (#18841)

JTischbein committed 47 days ago

Verified aa1dc377

CANN: Remove unused `ggml_cann_get_device` function (#18625)

rauletorresc committed 47 days ago

Verified 4ea2eaac

CANN: fix an issue where get_env was not fully renamed (#18796)

noemotiovon committed 47 days ago

Verified e20fa27a

CANN: support gated linear attn (#18653)

hipudding committed 47 days ago

Verified baa4ba0a

OpenCL: add SOLVE_TRI op support (#18846)

shaofeiqi committed 48 days ago

Verified 785a7100

cuda : print less debug logs when disabling cuda graphs (#18868)

ggerganov committed 48 days ago

Verified 6e7fc8a1

context : do not reserve scheduler for warmups (#18867)

ggerganov committed 48 days ago

Verified be8e3d95

llama : add adaptive-p sampler (#17927)

ddh0 committed 48 days ago

Verified 13f1e4a9

Older