ngxson/llama.cpp

Pull Requests Commits

server : bump httplib to 0.19.0

ngxson committed 1 year ago

ae6222ee

common : Fix a typo in help (#11899)

standby24x7 committed 1 year ago

Verified fe163d5b

ci : fix (again) arm64 build fails (#11895)

ngxson committed 1 year ago

Verified 818a340e

vulkan: support multi/vision rope, and noncontiguous rope (#11902)

jeffbolznv committed 1 year ago

Verified bf42a23d

metal : fix the crash caused by the lack of residency set support on Intel Macs. (#11904)

halechan committed 1 year ago

Verified c2ea16f2

scripts: fix compare-llama-bench commit hash logic (#11891)

JohannesGaessler committed 1 year ago

Verified 6dde1782

examples: fix typo in imatrix/README.md (#11884)

708-145 committed 1 year ago

Verified fc10c38d

metal : optimize dequant q6_K kernel (#11892)

akretz committed 1 year ago

Verified 22885105

readme : add notice about new package registry (#11890)

ggerganov committed 1 year ago

Verified c2cd24fb

repo : update links to new url (#11886)

ggerganov committed 1 year ago

Verified 68ff663a

server: fix type promotion typo causing crashes w/ --jinja w/o tools (#11880)

ochafik committed 1 year ago

Verified f3552296

vulkan: initial support for IQ1_S and IQ1_M quantizations (#11528)

remyoudompheng committed 1 year ago

Verified fc1b0d09

llguidance build fixes for Windows (#11664)

mmoskal committed 1 year ago

Verified 89daa256

opencl: Fix rope and softmax (#11833)

lhez committed 1 year ago

Verified 300907b2

cuda : add ampere to the list of default architectures (#11870)

slaren committed 1 year ago

Verified 94b87f87

docker : drop to CUDA 12.4 (#11869)

ggerganov committed 1 year ago

Verified dbc2ec59

llama : add completion for --chat-template-file (#11860)

danbev committed 1 year ago

Verified 3d68f034

ggml: optimize some vec dot functions for LoongArch ASX (#11842)

MQ-mengqing committed 1 year ago

Verified 38e32eb6

vulkan: linux builds + small subgroup size fixes (#11767)

netrunnereve committed 1 year ago

Verified a4f011e8

llama-bench : fix unexpected global variable initialize sequence issue (#11832)

theraininsky committed 1 year ago

Verified a7b8ce22

ggerganov committed 1 year ago

Verified 04045bb8

llamafile: use member variable instead of constant for iq4nlt (#11780)

jmorganca committed 1 year ago

Verified 8a8c4ceb

server : (docs) Update wrong tool calling example (#11809)

RezaRahemtola committed 1 year ago

Verified c1f958c0

llama : add --completion-bash option (#11846)

danbev committed 1 year ago

Verified c48f630d

musa: bump MUSA SDK version to rc3.1.1 (#11822)

yeahdongcn committed 1 year ago

Verified bd6e55bf

`server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607)

ochafik committed 1 year ago

Verified c7f460ab

sampling: add Top-nσ sampler (#11223)

VJHack committed 1 year ago

Verified 27e8a233

llama.cpp: fix warning message (#11839)

okuvshynov committed 1 year ago

Verified e4376270

llama : update llama_decode_internal ref [no ci] (#11840)

danbev committed 1 year ago

Verified 3e693197

ggml-cpu : add chunking support to mul_mat_id (#11666)

slaren committed 1 year ago

Verified a394039d

Older