ggml-org/llama.cpp

Pull Requests Commits

ggerganov committed 1 year ago

Verified 4317d5ab

kv-cache : remove LLAMA_SET_ROWS checks (#15505)

ggerganov committed 1 year ago

Verified 8a4280ce

gguf-py: byteswapping improvements (#12851)

AlekseiNikiforovIBM committed 1 year ago

Verified 64387f6e

cli : change log to warning to explain reason for stopping (#15604)

jrincayc committed 1 year ago

Verified d35a1e8c

model-conversion : add mmproj conversion target (#15628)

danbev committed 1 year ago

Verified 46d9caa2

cuda: Add cublasLt_static linking when GGML_STATIC is enabled (#15622)

matiaslin committed 1 year ago

Verified 5a0e3ef6

server: higher timeout for tests (#15621)

JohannesGaessler committed 1 year ago

Verified fbef0fad

presets : add qwen3-30B-a3b FIM (#15616)

ggerganov committed 1 year ago

Verified da54f9f1

HIP: Enable support for ggml_backend_cuda_register_host_buffer (#15615)

IMbackK committed 1 year ago

Verified 47373271

kv-cache : better estimate of n_kv for multi-sequence batches (#15610)

ggerganov committed 1 year ago

Verified 1bded5a3

CANN: refactor mask handling and improve performance in FA (#15561)

noemotiovon committed 1 year ago

Verified 1e748974

ggml-cpu : add basic RVV support for vector f32 ops (#15057)

xctan committed 1 year ago

Verified 1cf123a3

common : add -m to bash completion for --model [no ci] (#15591)

danbev committed 1 year ago

Verified fcca2182

OpenCL: add fused group_norm/norm, mul, add (#15314)

rmatif committed 1 year ago

Verified 86076f92

tests : fix test-opt with GGML_BACKEND_DL (#15599)

slaren committed 1 year ago

Verified bcbddcd5

SYCL: fix rms_norm_mul_add for tensor dim not a multiple of sg_size (#15592)

qnixsynapse committed 1 year ago

Verified 8b696861

mtmd : fix mtmd ios build (#15579)

fidoriel committed 1 year ago

Verified 8ce3ff1d

tests: add performance test for mul mat id (#15543)

netrunnereve committed 1 year ago

Verified 44b1efa4

llamafile: PowerPC Sgemm Optimization (#15558)

shalinib-ibm committed 1 year ago

Verified a6a58d64

graph : fix assert in memory-less build_attn (#15590)

ggerganov committed 1 year ago

Verified 0373486d

model-conversion : add qat-q4 quantization targets (#15588)

danbev committed 1 year ago

Verified 62cef26a

CUDA: return -1 for nonexistent compiled arch (#15587)

JohannesGaessler committed 1 year ago

Verified 8f5afa94

metal : optimize FA vec for large sequences and BS <= 8 (#15566)

ggerganov committed 1 year ago

Verified b3964c1e

mtmd : support Kimi VL model (#15458)

ngxson committed 1 year ago

Verified 79a54622

context : print graph stats for memory-less contexts (#15586)

ggerganov committed 1 year ago

Verified 85cc1ae9

metal : improve `MUL_MAT_ID` (#15541)

ggerganov committed 1 year ago

Verified 1d8d83de

model : support MiniCPM-V 4.5 (#15575)

tc-mb committed 1 year ago

Verified c4e92390

gguf-py : remove erroneous FFN_GATE entry (#15583)

CISC committed 1 year ago

Verified 39842a7f

metal : remove contiguous assertion for src0 in IM2COL (#15577)

CISC committed 1 year ago

Verified 0fd90db5

Add a warning for special devices (#15563)

pt13762104 committed 1 year ago

Verified 4c37636b

Older