ngxson/llama.cpp

Pull Requests Commits

minor fix and cleanup

CISC committed 26 days ago

Verified 1daef5f8

Update src/llama-model.cpp

ngxson committed 26 days ago

Verified 7b23cd92

ngxson committed 26 days ago

82554013

Apply suggestions from code review

ngxson committed 27 days ago

Verified 9bfafada

ngxson committed 27 days ago

d8a46565

add indexer gguf params

ngxson committed 27 days ago

64184c12

keep indexer tensors

ngxson committed 27 days ago

9e4e556c

ngxson committed 29 days ago

0451c849

working version

ngxson committed 29 days ago

a44a3dbc

model: support GLM MoE DSA arch

ngxson committed 29 days ago

cc0d6c28

spec : remove check rate (#19377)

srogmann committed 29 days ago

Verified 292f6908

ci : add metal server workflows (#19293)

ggerganov committed 29 days ago

Verified 81ddc60c

revert : "[Model] Qwen3.5 dense and MoE support (no vision) (#19435)" (#19453)

ggerganov committed 29 days ago

Verified 972f323e

ggml-virtgpu: add backend documentation (#19354)

kpouget committed 30 days ago

Verified f5e7734f

cmake : add variable to skip installing tests (#19370)

WhyNotHugo committed 30 days ago

Verified 1e8924fd

[Model] Qwen3.5 dense and MoE support (no vision) (#19435)

pwilkin committed 30 days ago

Verified 39bf692a

CUDA: Fix non-contig rope (#19338)

ORippler committed 30 days ago

Verified e06088da

rpc : update from common.cpp (#19400)

angt committed 31 days ago

Verified 5fa1c190

server : improve context checkpoint logic (#19408)

ggerganov committed 31 days ago

Verified eb449cdf

llama-quantize : cleanup `--help` output (#19317)

ddh0 committed 31 days ago

Verified 5999b50e

ci : remove server job from webui and move slow test (#19424)

CISC committed 31 days ago

Verified 9a5f5779

ci : use -j param correctly when building with sanitizers (#19411)

ggerganov committed 31 days ago

Verified 96441c95

metal : consolidate bin kernels (#19390)

ggerganov committed 32 days ago

Verified 8872ad21

metal : fix event synchronization in cpy_tensor_async (#19402)

ggerganov committed 32 days ago

Verified 34ba7b5a

model : support Step3.5-Flash (#19283)

forforever73 committed 32 days ago

Verified b8311181

gguf-py : bump sentencepiece version (#19319)

Ahajha committed 32 days ago

Verified 3228e772

ggml-webgpu: JIT compile binary operators and handle binding overlaps (#19310)

abhijitramesh committed 32 days ago

Verified 7fbd36c5

sycl: add F16 support for GGML_OP_CEIL (#19306)

NechamaKrashinski committed 32 days ago

Verified 537eadb1

tests: reduce number of FA test permutations (#19381)

jeffbolznv committed 32 days ago

Verified db6adb3c

common : add common_speculative_is_compat() (#19270)

ggerganov committed 32 days ago

Verified dfde5993

Older