ngxson/llama.cpp

Pull Requests Commits

ngxson committed 1 year ago

8913e784

windows: fix problem with std::min and std::max

ngxson committed 1 year ago

e247e980

fix multi-shard download

ngxson committed 1 year ago

0c7b2348

only handle mmproj in llava example

ngxson committed 1 year ago

29666398

gemma3: update readme

ngxson committed 1 year ago

583deffb

fix mmproj with -hf

ngxson committed 1 year ago

05e9d3e1

fix all examples

ngxson committed 1 year ago

4155c452

(wip) refactor downloading system [no ci]

ngxson committed 1 year ago

7f92e8a6

llama : use LLM_KV_GENERAL_FILE_TYPE instead of gguf_find_key (#12672)

jklincn committed 1 year ago

Verified e39e727e

convert : BailingMoE : fix qkv split when head_dim is 0 (#12687)

CISC committed 1 year ago

Verified 5936a616

metal : use F32 prec in FA kernels (#12688)

ggerganov committed 1 year ago

Verified 3fd072a5

Fix clang warning in gguf_check_reserved_keys (#12686)

yeahdongcn committed 1 year ago

Verified a6f32f0b

vulkan: fix build when glslc doesn't support coopmat (#12683)

wbruna committed 1 year ago

Verified 2bb3597e

SYCL: Rename oneMKL to oneMath (#12192)

Rbiessy committed 1 year ago

Verified 82939705

SYCL: switch to SYCL namespace (#12674)

qnixsynapse committed 1 year ago

Verified 8bbf2608

convert : BailingMoE : avoid setting rope_dim to 0 (#12678)

CISC committed 1 year ago

Verified 35782aee

vocab : add special infill tokens for CodeLlama (#11850)

danbev committed 1 year ago

Verified c80a7759

ggml : faster ssm scan (#10558)

A3shTnT committed 1 year ago

Verified 250d7953

convert : Qwerky : use lora_rank_tokenshift and lora_rank_decay if present (#12667)

CISC committed 1 year ago

Verified 403fbacb

Vulkan: Add DP4A MMQ and Q8_1 quantization shader (#12135)

0cc4m committed 1 year ago

Verified a8a1f335

cmake : fix whitespace (#0)

ggerganov committed 1 year ago

1790e731

ggerganov committed 1 year ago

0114a32d

cmake: improve Vulkan cooperative matrix support checks (whisper/2966)

sandrohanea committed 1 year ago

a7724480

llava : proper description fix (#12668)

CISC committed 1 year ago

Verified 1a859490

SYCL: Remove misleading ggml_sycl_op_flatten function (#12387)

qnixsynapse committed 1 year ago

Verified 6c02a032

llava : fix clip loading GGUFs with missing description (#12660)

CISC committed 1 year ago

Verified f52d59d7

tts : remove printfs (#12640)

marcoStocchi committed 1 year ago

Verified 52de2e59

llama : support BailingMoE (Ling) (#12634)

CISC committed 1 year ago

Verified 2c3f8b85

metal : use constexpr in FA kernels + fix typedef (#12659)

ggerganov committed 1 year ago

Verified 4663bd35

llama : add Trillion 7B model support (#12556)

juyoung-trl committed 1 year ago

Verified b3de7cac

Older