ggml-org/llama.cpp

Pull Requests Commits

ggml : fix SSM_SCAN for n_groups > 1

compilade committed 1 year ago

dc2187d4

server: higher timeout for tests (#15621)

JohannesGaessler committed 1 year ago

Verified fbef0fad

presets : add qwen3-30B-a3b FIM (#15616)

ggerganov committed 1 year ago

Verified da54f9f1

HIP: Enable support for ggml_backend_cuda_register_host_buffer (#15615)

IMbackK committed 1 year ago

Verified 47373271

kv-cache : better estimate of n_kv for multi-sequence batches (#15610)

ggerganov committed 1 year ago

Verified 1bded5a3

CANN: refactor mask handling and improve performance in FA (#15561)

noemotiovon committed 1 year ago

Verified 1e748974

ggml-cpu : add basic RVV support for vector f32 ops (#15057)

xctan committed 1 year ago

Verified 1cf123a3

common : add -m to bash completion for --model [no ci] (#15591)

danbev committed 1 year ago

Verified fcca2182

OpenCL: add fused group_norm/norm, mul, add (#15314)

rmatif committed 1 year ago

Verified 86076f92

tests : fix test-opt with GGML_BACKEND_DL (#15599)

slaren committed 1 year ago

Verified bcbddcd5

SYCL: fix rms_norm_mul_add for tensor dim not a multiple of sg_size (#15592)

qnixsynapse committed 1 year ago

Verified 8b696861

mtmd : fix mtmd ios build (#15579)

fidoriel committed 1 year ago

Verified 8ce3ff1d

tests: add performance test for mul mat id (#15543)

netrunnereve committed 1 year ago

Verified 44b1efa4

llamafile: PowerPC Sgemm Optimization (#15558)

shalinib-ibm committed 1 year ago

Verified a6a58d64

graph : fix assert in memory-less build_attn (#15590)

ggerganov committed 1 year ago

Verified 0373486d

model-conversion : add qat-q4 quantization targets (#15588)

danbev committed 1 year ago

Verified 62cef26a

CUDA: return -1 for nonexistent compiled arch (#15587)

JohannesGaessler committed 1 year ago

Verified 8f5afa94

metal : optimize FA vec for large sequences and BS <= 8 (#15566)

ggerganov committed 1 year ago

Verified b3964c1e

mtmd : support Kimi VL model (#15458)

ngxson committed 1 year ago

Verified 79a54622

context : print graph stats for memory-less contexts (#15586)

ggerganov committed 1 year ago

Verified 85cc1ae9

metal : improve `MUL_MAT_ID` (#15541)

ggerganov committed 1 year ago

Verified 1d8d83de

model : support MiniCPM-V 4.5 (#15575)

tc-mb committed 1 year ago

Verified c4e92390

gguf-py : remove erroneous FFN_GATE entry (#15583)

CISC committed 1 year ago

Verified 39842a7f

metal : remove contiguous assertion for src0 in IM2COL (#15577)

CISC committed 1 year ago

Verified 0fd90db5

Add a warning for special devices (#15563)

pt13762104 committed 1 year ago

Verified 4c37636b

vulkan: Remove splitting for mul_mat_id (#15568)

jeffbolznv committed 1 year ago

Verified 34bdbbd7

CUDA: Accelerate MXFP4 table lookup using `__byte_perm` (#15451)

Qeeweew committed 1 year ago

Verified 74f52f77

opencl: fix support ops condition for `rms_norm` (#15560)

lhez committed 1 year ago

Verified f7207b04

vulkan: fix min subgroup 16 condition for mmid subgroup optimization (#15565)

0cc4m committed 1 year ago

Verified 4d917cd4

tests: Generate unique input values for count_equal (#15487)

jeffbolznv committed 1 year ago

Verified 886b97a5

Older