ngxson/llama.cpp

Pull Requests Commits

Update common/arg.cpp

ngxson committed 1 year ago

Verified c1a49b79

Merge branch 'master' into xsn/clip_no_mmproj_offload

ngxson committed 1 year ago

Verified acde5ef4

arg : clean up handling --mmproj with -hf (#13082)

ngxson committed 1 year ago

Verified 80982e81

arg : add --no-mmproj-offload

ngxson committed 1 year ago

b39c925a

metal : fix floating-point range of attention scores in FA kernels (#13090)

ggerganov committed 1 year ago

Verified 7604a7d6

vulkan: matmul gcn tuning (#13016)

netrunnereve committed 1 year ago

Verified b3b6d862

llama-mtmd-cli: Sigint rework in mtmd vision example (#13080)

pl752 committed 1 year ago

Verified 56304069

mtmd : Support Pixtral 12B (#13065)

ngxson committed 1 year ago

Verified ecda2ec4

convert : Append mult-eos,half-rope,bos to GLM4-0414 and Z (#13021)

piDack committed 1 year ago

Verified eb1776b1

rpc : add command line option for number of threads for the CPU backend (#13060)

rgerganov committed 1 year ago

Verified 2cca6c01

CUDA: noncont MMVQ + batched bs1 MUL_MAT_ID (#13014)

JohannesGaessler committed 1 year ago

Verified 658987cf

mtmd : support SmolVLM (version 1 and 2) (#13050)

ngxson committed 1 year ago

Verified dc39a5e7

security : add note about RPC and server functionality (#13061)

ggerganov committed 1 year ago

Verified ab47dec3

metal : add memory pool for temp allocs (#12850)

ggerganov committed 1 year ago

Verified 7b53389c

llava : update documentations (#13055)

ngxson committed 1 year ago

Verified 24345353

ggml : add SSE 4.2 and x64 base variant for CPUs without AVX (#12871)

slaren committed 1 year ago

Verified 1d735c0b

SYCL: Add non-contiguous support in ROPE (#12993)

qnixsynapse committed 1 year ago

Verified 5368ddda

mtmd : merge llava, gemma3 and minicpmv CLI into single `llama-mtmd-cli` (#13012)

ngxson committed 1 year ago

Verified 84a9bf2f

convert : experimental support for `--mmproj` flag (#13023)

ngxson committed 1 year ago

Verified 2016f07b

llava: fix errors in clip.h on certain compilers (#13030)

jmorganca committed 1 year ago

Verified 66023048

vulkan: support noncontiguous rms_norm (#13031)

jeffbolznv committed 1 year ago

Verified 66168204

metal: add neg operator (#13029)

jmorganca committed 1 year ago

Verified 4ba9d711

Disable CI cross-compile builds (#13022)

mtmcp committed 1 year ago

Verified 00137157

gguf-py : fix upload python package workflow (#13020)

CISC committed 1 year ago

Verified fb28f4f8

clip : refactor, add `image_manipulation` and `llava_uhd` classes (#13011)

ngxson committed 1 year ago

Verified 37b9f0d2

main : Fix Ctrl+D/newline handling (#12951)

danielzgtg committed 1 year ago

Verified 64082100

gguf-py : GGUF Editor GUI - Python + Qt6 (#12930)

christopherthompson81 committed 1 year ago

Verified aff9d107

server : use std::move whenever possible (#12936)

ngxson committed 1 year ago

Verified 35370ba9

SYCL: Refactor and enable FP16 in binary broadcast OPs (#12975)

qnixsynapse committed 1 year ago

Verified 8d660057

mtmd : add methods to access `mtmd_image_tokens` (#12906)

ngxson committed 1 year ago

Verified b9154ecf

Older