ngxson/llama.cpp

Pull Requests Commits

add newline at correct place

ngxson committed 1 year ago

bd40850d

Update gguf-py/gguf/metadata.py

ngxson committed 1 year ago

Verified f6c25d9c

convert : fix Norway problem when parsing YAML

ngxson committed 1 year ago

683308a9

ggml : upgrade init_tensor API to return a ggml_status (#11854)

WilliamTambellini committed 1 year ago

Verified 70680c48

llama : add Phi-4-mini support (supersede #12099) (#12108)

ngxson committed 1 year ago

Verified c43a3e79

Update granite vision docs for 3.2 model (#12105)

alex-jw-brooks committed 1 year ago

Verified 84d5f4bc

vulkan: add specific MMV kernels for IQ2 and IQ3 quants + optimizations (#11595)

remyoudompheng committed 1 year ago

Verified 438a8392

CUDA: fix logic for V100 + GGML_CUDA_FORCE_MMQ (#12098)

JohannesGaessler committed 1 year ago

Verified 9c42b171

ggml: aarch64: implement SVE kernels for q2_k_q8_k vector dot (#12064)

Vithulep committed 1 year ago

Verified 05e6f5aa

CANN: Fix build error with GCC 13 (#11990)

hipudding committed 1 year ago

Verified 673cfef9

vulkan: matmul dequantization improvements (#12015)

netrunnereve committed 1 year ago

Verified fbeda900

vulkan: improve im2col (#11826)

daniandtheweb committed 1 year ago

Verified 581650b7

cmake: Fix ggml backend dependencies and installation (#11818)

vvuksanovic committed 1 year ago

Verified b95c8af3

llava : add struct for FFI bindgen (#12079)

tinglou committed 1 year ago

Verified a800ae46

Refactor gguf scripts to improve metadata handling (#11909)

CISC committed 1 year ago

Verified 69050a11

gguf-py: enable reading non-native endian files (#12081)

AlekseiNikiforovIBM committed 1 year ago

Verified 3567ee3a

readme : update infra list (#9096)

kerthcet committed 1 year ago

Verified 53e4db10

docs: add docs/function-calling.md to lighten server/README.md's plight (#12069)

ochafik committed 1 year ago

Verified d7cfe1ff

vulkan: fix assertion when qy_needs_dequant (#12068)

jeffbolznv committed 1 year ago

Verified a82c9e7c

server: handle echo=false on /v1/completions (#12060)

rhjdvsgsgks committed 1 year ago

Verified 401af80b

add OP sigmoid (#12056)

foldl committed 1 year ago

Verified c132239b

ggml-cpu: Fix build with sve (#12059)

MollySophia committed 1 year ago

Verified 393fca62

vulkan: implement more backpropagation operators (#11914)

remyoudompheng committed 1 year ago

Verified 61d4f39d

server: support add_generation_prompt query param (#12062)

ochafik committed 1 year ago

Verified 0b527456

Add Doc for Converting Granite Vision -> GGUF (#12006)

alex-jw-brooks committed 1 year ago

Verified 4d1051a4

llama : expose llama_model_n_head_kv in the API (#11997)

vlovich committed 1 year ago

Verified 3e9a2860

metal : copy kernels for quant to F32/F16 conversions (#12017)

gcp committed 1 year ago

Verified 58d07a80

opencl: fix for small models (#11950)

lhez committed 1 year ago

Verified 34a846b5

llava : Add Granite Vision Support (#11794)

alex-jw-brooks committed 1 year ago

Verified 7a2c913e

[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)

NeoZhangJianyu committed 1 year ago

Verified 08d59862

Older