ochafik/llama.cpp

Pull Requests Commits

cuda/cpu: Increase support for fp16 unary operations (ggml/1125)

cmdr2 committed 1 year ago

87abb7e9

whisper : support GGML_BACKEND_DL (whisper/2843)

slaren committed 1 year ago

6d4c23b8

cmake : fix compile assumptions for power9/etc (whisper/2777)

midnightmagic committed 1 year ago

6512a900

Told cmake to install ggml-cpp.h as a public header file. (ggml/1126)

petterreinholdtsen committed 1 year ago

45120557

Support pure float16 add/sub/mul/div operations in the CUDA (and CPU) backend (ggml/1121)

cmdr2 committed 1 year ago

f54a4ba1

scripts : sync-ggml-am.sh fix

ggerganov committed 1 year ago

aede2074

ci : set GITHUB_ACTION env var for server tests (#12162)

danbev committed 1 year ago

Verified 2679c3b5

tts: add speaker file support (#12048)

dm4 committed 1 year ago

Verified c43af927

test-backend-ops : add option -p to filter by op params (#12155)

slaren committed 1 year ago

Verified d5c63cd7

ggml : fix kleidiai build (#12159)

ag2s20150909 committed 1 year ago

Verified 9660ffef

Adding UTF-8 support to llama.cpp (#12111)

ericcurtin committed 1 year ago

Verified c950a1f6

webui : add ?m=... and ?q=... params (#12148)

ngxson committed 1 year ago

Verified 7b69003a

SYCL: Move CPY kernels to a separate file and add few missing kernels (#12133)

qnixsynapse committed 1 year ago

Verified ece9745b

ggml-backend : keep paths in native string type when possible (#12144)

slaren committed 1 year ago

Verified cc473cac

main: use jinja chat template system prompt by default (#12118)

CISC committed 1 year ago

Verified 14dec0c2

main: update outdated system prompt message (followup to #12131) (#12132)

CISC committed 1 year ago

Verified 1782cdfe

common : add --system-prompt parameter, replace behavior of -p in conversation mode (#12131)

CISC committed 1 year ago

Verified 45a8e767

CUDA: compress mode option and default to size (#12029)

Green-Sky committed 1 year ago

Verified 80c41ddd

webui : minor typo fixes (#12116)

vynride committed 1 year ago

Verified 2cc4a5e4

convert : fix Norway problem when parsing YAML (#12114)

ngxson committed 1 year ago

Verified 06c2b156

ggml : upgrade init_tensor API to return a ggml_status (#11854)

WilliamTambellini committed 1 year ago

Verified 70680c48

llama : add Phi-4-mini support (supersede #12099) (#12108)

ngxson committed 1 year ago

Verified c43a3e79

Update granite vision docs for 3.2 model (#12105)

alex-jw-brooks committed 1 year ago

Verified 84d5f4bc

vulkan: add specific MMV kernels for IQ2 and IQ3 quants + optimizations (#11595)

remyoudompheng committed 1 year ago

Verified 438a8392

CUDA: fix logic for V100 + GGML_CUDA_FORCE_MMQ (#12098)

JohannesGaessler committed 1 year ago

Verified 9c42b171

ggml: aarch64: implement SVE kernels for q2_k_q8_k vector dot (#12064)

Vithulep committed 1 year ago

Verified 05e6f5aa

CANN: Fix build error with GCC 13 (#11990)

hipudding committed 1 year ago

Verified 673cfef9

vulkan: matmul dequantization improvements (#12015)

netrunnereve committed 1 year ago

Verified fbeda900

vulkan: improve im2col (#11826)

daniandtheweb committed 1 year ago

Verified 581650b7

cmake: Fix ggml backend dependencies and installation (#11818)

vvuksanovic committed 1 year ago

Verified b95c8af3

Newer Older