ngxson/llama.cpp

Pull Requests Commits

ngxson committed 67 days ago

2312fad1

check prefix instead

ngxson committed 67 days ago

aacdf2ba

Update src/llama.cpp

ngxson committed 67 days ago

Verified 94e32467

llama-quant: add support for mmproj

ngxson committed 67 days ago

3bf33aac

metal : avoid using Metal's gpuAddress property (#16576)

ggerganov committed 67 days ago

Verified fa882fd2

vulkan: Add ACC_TYPE_VEC2 implementation (#16203)

SavicStefan committed 67 days ago

Verified ffa05903

CUDA + openCL: fix bug in accessing rms_norm->src while doing fusion (#16577)

am17an committed 67 days ago

Verified 120bf704

vulkan: Support FA with K/V in F32 (#16543)

jeffbolznv committed 68 days ago

Verified 4258e0cf

vulkan: Improve build time for MSVC (#16545)

jeffbolznv committed 68 days ago

Verified 7ea15bb6

CUDA: enable FA for FP32 KV cache (#16546)

JohannesGaessler committed 68 days ago

Verified 9c7185dd

CUDA: use fastdiv + ggml_cuda_mad for mmvf (#16557)

am17an committed 68 days ago

Verified 1ee9d0b4

CUDA: add fp kernel for larger batch size MoE (#16512)

am17an committed 68 days ago

Verified 48e2fa9f

cuda : remove legacy copy-op pointer indirection code (#16485)

anavp-nvidia committed 68 days ago

Verified 5b6913c4

server : dynamic token limit for prompt cache (#16560)

ggerganov committed 68 days ago

Verified bc07349a

metal : FA support F32 K and V and head size = 32 (#16531)

ggerganov committed 68 days ago

Verified e60f241e

graph : support cacheless embeddings with FA and iSWA (#16528)

ggerganov committed 68 days ago

Verified e38b7c6e

opencl: fix build targeting CL 2 (#16554)

lhez committed 68 days ago

Verified 5016b728

CUDA: fix numerical issues in tile FA kernel (#16540)

JohannesGaessler committed 68 days ago

Verified 7049736b

ggml : fix build broken with -march=armv9-a on MacOS (#16520)

DamonFool committed 69 days ago

Verified 01d2bdc2

CANN: fix CPU memory leak in CANN backend (#16549)

noemotiovon committed 69 days ago

Verified 56fc38b9

fix: add remark plugin to render raw HTML as literal text (#16505)

ServeurpersoCom committed 69 days ago

Verified 1fb9504e

metal: add support for opt_step_sgd (#16539)

cern1710 committed 69 days ago

Verified 3f750f8d

ggml : fix scalar path for computing norm (#16558)

ggerganov committed 69 days ago

Verified c515fc57

CANN: Update several operators to support FP16 data format (#16251)

hipudding committed 69 days ago

Verified f9bc66c3

metal : add opt_step_adamw and op_sum (#16529)

cern1710 committed 69 days ago

Verified a31cf36a

webui: remove client-side context pre-check and rely on backend for limits (#16506)

ServeurpersoCom committed 69 days ago

Verified 81d54bbf

[SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521)

NeoZhangJianyu committed 70 days ago

Verified c7be9feb

ci : add Vulkan on Ubuntu with default packages build (#16532)

mbaudier committed 70 days ago

Verified 8415f61e

common : handle unicode during partial json parsing (#16526)

aldehir committed 70 days ago

Verified 2c301e91

common : update presets (#16504)

ggerganov committed 70 days ago

Verified 4b2dae38

Older