ngxson/llama.cpp

Pull Requests Commits

ngxson committed 329 days ago

19be0a8d

llama : add support for Deepseek-R1-Qwen distill model

ngxson committed 329 days ago

7542b6d6

cont : fix whitespaces (#11305)

ggerganov committed 329 days ago

Verified ef6dada6

llama : re-add LLM_ARCH_PHIMOE (#11305)

KyleBruene committed 329 days ago

Verified ae3c1db2

tests : increase timeout when sanitizers are enabled (#11300)

ggerganov committed 330 days ago

Verified 92bc4939

simple-chat : fix BOS being added to each message (#11278)

ggerganov committed 330 days ago

Verified b9daaffe

SYCL: Introducing memory host pool (#11251)

s-Nick committed 330 days ago

Verified 99487b57

Adding linenoise.cpp to llama-run (#11252)

ericcurtin committed 331 days ago

Verified a1649cc1

cmake : add sanitizer flags for llama.cpp (#11279)

ggerganov committed 331 days ago

Verified 4dd34ff8

server : implement cancellable request (#11285)

ngxson committed 331 days ago

Verified f30f0992

scripts : restore hf.sh (#11288)

ggerganov committed 331 days ago

Verified f26c8741

tts : add guide tokens support (#11186)

LostRuins committed 331 days ago

Verified 6390a998

vulkan: fix coopmat2 flash attention for non-contiguous inputs (#11281)

jeffbolznv committed 331 days ago

Verified 44e18ef9

llama.android: add field formatChat to control whether to parse special tokens when send message (#11270)

codezjx committed 332 days ago

Verified 3edfa7d3

rpc : early register backend devices (#11262)

rgerganov committed 332 days ago

Verified 667d7284

vocab : fix double-eos check (#11273)

ggerganov committed 332 days ago

Verified a133566d

llama : fix deprecation message: vocabable -> vocab (#11269)

dwrensha committed 332 days ago

Verified 960ec652

README : added kalavai to infrastructure list (#11216)

musoles committed 333 days ago

Verified 7a689c41

vulkan: support copy from f32 to q4_0/q4_1/q5_0/q5_1/q8_0/iq4_nl (#11166)

jeffbolznv committed 333 days ago

Verified bd38ddea

vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (#11206)

jeffbolznv committed 333 days ago

Verified 466300fe

vulkan: optimize coopmat2 q2_k dequant function (#11130)

jeffbolznv committed 333 days ago

Verified 206bc534

llama : add internlm3 support (#11233)

RunningLeon committed 333 days ago

Verified 4dbc8b9c

CUDA: backwards pass for misc. ops, add tests (#11257)

JohannesGaessler committed 333 days ago

Verified 9c8dcefe

llama : add `llama_model_load_from_splits` (#11255)

ngxson committed 333 days ago

Verified 681149ce

ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227)

fj-y-saito committed 333 days ago

Verified c67cc983

vulkan: scale caching for k quants + misc fixes (#11081)

netrunnereve committed 334 days ago

Verified adc5dd92

ci : use -no-cnv in gguf-split tests (#11254)

ggerganov committed 334 days ago

Verified f11cfdfd

fix: ggml: fix vulkan-shaders-gen build (#10448)

sparkleholic committed 334 days ago

Verified 1d850433

RoPE: fix back, CUDA support for back + noncont. (#11240)

JohannesGaessler committed 334 days ago

Verified 432df2d5

examples : add embd_to_audio to tts-outetts.py [no ci] (#11235)

danbev committed 335 days ago

Verified 0ccd7f3e

Older