ggerganov/llama.cpp

Pull Requests Commits

change initialization to true

CISC committed 2 days ago

Verified 7315fc0d

fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl

CISC committed 2 days ago

Verified f50c60d6

graph : support non-contiguous Q in build_attn_mha (#15908)

CISC committed 3 days ago

Verified 6ab397e1

ggml-cpu : fix padding in ggml_timestep_embedding (#15917)

danbev committed 3 days ago

Verified 9de447d9

metal : make the backend async (#15906)

ggerganov committed 3 days ago

Verified 0f0a3c28

ci : add caching for ROCm installation in release workflow (#15924)

danbev committed 3 days ago

Verified 33daece8

tests : filter out no-ops from coverage report (#15900)

danbev committed 3 days ago

Verified e7b6d83b

media : add transparent icon svg and png [no ci] (#15891)

06kellyjac committed 3 days ago

Verified 2cfef4d1

gitignore : Ignore vim swap files in tests (#15901)

createthis committed 3 days ago

Verified 09e72a03

CANN: Add ROPE sin/cos cache for reuse (#15912)

noemotiovon committed 3 days ago

Verified 10d8b2b6

CANN: implement LRU cache for ACL graphs (#15814)

noemotiovon committed 3 days ago

Verified 28b5f190

llama : check returned fn ptrs from ggml_backend_reg_get_proc_address (#15893)

danbev committed 3 days ago

Verified 86587da0

ci : cache ROCm installation in windows-latest-cmake-hip (#15887)

danbev committed 3 days ago

Verified ff02caf9

vulkan: throw the oom error instead of no memory type found (#15905)

0cc4m committed 3 days ago

Verified ae355f6f

vulkan: Fix OOB accesses in soft_max_back (#15861)

jeffbolznv committed 4 days ago

Verified 4f63cd70

HIP: use v_dot2_f32_f16 instruction for FA (#15884)

JohannesGaessler committed 4 days ago

Verified 17bc5a81

Workaround for subgroup arithmetic failing on MoltenVK with AMD GPUs (issue 15846) (#15886)

lksj92hs committed 4 days ago

Verified ed54e325

CUDA: Add mul_mat_id support for the mmf kernel (#15767)

am17an committed 4 days ago

Verified a972faeb

CUDA: fix GET_ROWS for large tensors (#15882)

JohannesGaessler committed 4 days ago

Verified 550cf726

contrib : add notes about merging PRs (#15881)

ggerganov committed 4 days ago

Verified c252ce67

requirements : update transformers/torch for Embedding Gemma (#15828)

danbev committed 4 days ago

Verified 70cd37db

model-conversion : add extra debugging support for model conversion (#15877)

pwilkin committed 4 days ago

Verified acc1b008

json : support `enum` values within `allOf` (#15830)

aldehir committed 4 days ago

Verified 7057faf6

media : add llama1 icon (#15878)

06kellyjac committed 4 days ago

Verified fe1c92cd

vulkan: sort graph to allow more parallel execution (#15850)

jeffbolznv committed 4 days ago

Verified e68aa10d

CUDA: generate_cu_files.py - add missing mxfp4 (#15880)

am17an committed 5 days ago

Verified 0a16bf52

chat : Deepseek V3.1 reasoning and tool calling support (OpenAI Style) (#15533)

createthis committed 5 days ago

Verified 88021565

server : bring back timings_per_token (#15879)

ngxson committed 5 days ago

Verified 56920f56

cuda : fix supports_op condition for get_rows when number of blocks is too large (#15868)

ggerganov committed 5 days ago

Verified b0d52998

metal : refactor + optimize (#15857)

ggerganov committed 5 days ago

Verified f28d4f4a

Older