ggerganov/llama.cpp

Pull Requests Commits

ggml: aarch64: Implement SVE F16 kernels for vector functions (#15115)

Vithulep committed 67 days ago

Verified a0c2b207

convert : remove redundant code (#15708)

DamonFool committed 68 days ago

Verified 4b20d8b7

Vulkan: Add Integer Dot Product mul_mat_vec shader for legacy quants (#14903)

0cc4m committed 68 days ago

Verified 02c18135

ggml : WebGPU add TRANSPOSE and RESHAPE to supported ops (#15695)

danbev committed 68 days ago

Verified 77dee9de

docs : add Hunyuan to models section (#15707)

DamonFool committed 68 days ago

Verified 4795c91c

CUDA: fix build error from ambiguous __half conversions in conv2d (#15690)

qnixsynapse committed 68 days ago

Verified b66df9d9

CANN: Optimize MUL_MAT_ID (#15658)

hipudding committed 68 days ago

Verified b9382c38

CANN: fix RoPE cache issue on multi-device (#15629)

hipudding committed 68 days ago

Verified 3dc7397a

sampling : optimize samplers by reusing bucket sort (#15665)

ggerganov committed 68 days ago

Verified e92d53b2

server : enable /slots by default and make it secure (#15630)

ggerganov committed 68 days ago

Verified 0d161f02

metal : fix checks for available FA kernels (#15700)

ggerganov committed 68 days ago

Verified 4efd5a83

llama : fix fattn reserve call n_seqs parameter (#15699)

slaren committed 69 days ago

Verified 27496622

llama : separate compute buffer reserve from fattn check (#15696)

slaren committed 69 days ago

Verified 9777032d

ci : explicitly set fa off or on (#15692)

CISC committed 69 days ago

Verified 7d3c9f2b

vulkan: handle large sizes for get_rows (#15686)

jeffbolznv committed 69 days ago

Verified bbbf5ecc

vulkan: mul_mat_id coopmat2 optimizations (#15546)

jeffbolznv committed 69 days ago

Verified c37052ab

vulkan : remove unused portability_enumeration_ext variable (#15679)

danbev committed 69 days ago

Verified 5c16b9c8

vulkan: Allow fallback to sysmem memory when vidmem is full (#15649)

jeffbolznv committed 69 days ago

Verified b97c9edc

vulkan: clamp matmul and FA results to the max finite value (#15652)

jeffbolznv committed 69 days ago

Verified 94e82c7e

ggml: update kleidiai to v1.13.0 (#15663)

chaxu01 committed 70 days ago

Verified 4d74393b

Update build.md to remove MSVC arm64 notes (#15684)

slaren committed 70 days ago

Verified dd892555

llama: use FA + max. GPU layers by default (#15434)

JohannesGaessler committed 70 days ago

Verified e81b8e4b

CUDA: use FP32 arithmetic for conv2d (#15683)

JohannesGaessler committed 70 days ago

Verified 38ad381f

vulkan: Skip syncing for prealloc_y when it is reused (#15544)

jeffbolznv committed 70 days ago

Verified 696fccf3

CANN: FIx compiler warnings (#15661)

noemotiovon committed 70 days ago

Verified ef476916

server : removed obsolete doc (#15670)

l29ah committed 70 days ago

Verified d82f6aa3

scripts: strip "AMD Instinct" from GPU name (#15668)

JohannesGaessler committed 70 days ago

Verified 3d16b29c

server : add documentation for `parallel_tool_calls` param (#15647)

ExtReMLapin committed 70 days ago

Verified 792b44f2

CUDA: fix bug in rms_norm fusion (#15660)

am17an committed 71 days ago

Verified 81017865

chat : Seed OSS thinking + tool call support (#15552)

pwilkin committed 71 days ago

Verified 60e5eee3

Newer Older