ggerganov/llama.cpp

Pull Requests Commits

gguf-test: tensor data comparison

JohannesGaessler committed 290 days ago

ba421dd0

tests : fix gguf context use in same_tensor_data

ggerganov committed 291 days ago

Verified 7000623c

cmake : apply only sanitizer flags at top level

ggerganov committed 291 days ago

Verified e872097c

cmake : move llama.cpp compile flags to top level lists

ggerganov committed 291 days ago

Verified 9d1b20ad

cmake : move sanitizer flags to llama_add_compile_flags

ggerganov committed 291 days ago

Verified 9a03bc81

tests : fix compile warnings

ggerganov committed 291 days ago

Verified ce293d83

cmake : add sanitizer flags for llama.cpp

ggerganov committed 291 days ago

Verified 72dc7bff

llama.android: add field formatChat to control whether to parse special tokens when send message (#11270)

codezjx committed 291 days ago

Verified 3edfa7d3

rpc : early register backend devices (#11262)

rgerganov committed 291 days ago

Verified 667d7284

vocab : fix double-eos check (#11273)

ggerganov committed 291 days ago

Verified a133566d

llama : fix deprecation message: vocabable -> vocab (#11269)

dwrensha committed 291 days ago

Verified 960ec652

README : added kalavai to infrastructure list (#11216)

musoles committed 292 days ago

Verified 7a689c41

vulkan: support copy from f32 to q4_0/q4_1/q5_0/q5_1/q8_0/iq4_nl (#11166)

jeffbolznv committed 292 days ago

Verified bd38ddea

vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (#11206)

jeffbolznv committed 292 days ago

Verified 466300fe

vulkan: optimize coopmat2 q2_k dequant function (#11130)

jeffbolznv committed 292 days ago

Verified 206bc534

llama : add internlm3 support (#11233)

RunningLeon committed 292 days ago

Verified 4dbc8b9c

CUDA: backwards pass for misc. ops, add tests (#11257)

JohannesGaessler committed 292 days ago

Verified 9c8dcefe

llama : add `llama_model_load_from_splits` (#11255)

ngxson committed 292 days ago

Verified 681149ce

ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227)

fj-y-saito committed 292 days ago

Verified c67cc983

vulkan: scale caching for k quants + misc fixes (#11081)

netrunnereve committed 293 days ago

Verified adc5dd92

ci : use -no-cnv in gguf-split tests (#11254)

ggerganov committed 293 days ago

Verified f11cfdfd

fix: ggml: fix vulkan-shaders-gen build (#10448)

sparkleholic committed 293 days ago

Verified 1d850433

RoPE: fix back, CUDA support for back + noncont. (#11240)

JohannesGaessler committed 293 days ago

Verified 432df2d5

examples : add embd_to_audio to tts-outetts.py [no ci] (#11235)

danbev committed 293 days ago

Verified 0ccd7f3e

SYCL: Add gated linear attention kernel (#11175)

qnixsynapse committed 293 days ago

Verified f446c2cf

ci : add -no-cnv for tests (#11238)

ngxson committed 294 days ago

Verified b4d92a59

vocab : add dummy tokens for "no_vocab" type (#11231)

ggerganov committed 294 days ago

Verified bbf3e55e

server : Improve code snippets direction between RTL text (#11221)

ebraminio committed 294 days ago

Verified c5bf0d1b

Refactor test-chat-template.cpp (#11224)

ochafik committed 294 days ago

Verified 091592d7

ggerganov committed 294 days ago

Verified 44d1e796

Older