ochafik/llama.cpp

Pull Requests Commits
vulkan: move common FA code to flash_attn_base.comp (#13556)
jeffbolznv committed 1 year ago
Verified 2f5a4e1e
vulkan: use scalar FA rather than coopmat2 when N==1 (#13554)
jeffbolznv committed 1 year ago
Verified 4f41ee11
json-partial: add comments
ochafik committed 1 year ago
810c4c32
disable failing tests from test_tool_call.py
ochafik committed 1 year ago
8886c244
Merge remote-tracking branch 'origin/master' into tool-diffs
ochafik committed 1 year ago
6ddda107
chat-parser: remove input from exception (llm output may contain PII)
ochafik committed 1 year ago
224101b4
llguidance : official v0.7.20 release (no actual changes) [noci] (#13594)
CoffeeVampir3 committed 1 year ago
Verified 3e0be1ca
server : do not return error out of context (with ctx shift disabled) (#13577)
ngxson committed 1 year ago
Verified 6aa892ec
webui : improve accessibility for visually impaired people (#13551)
ngxson committed 1 year ago
Verified aea9f8b4
readme : add list of dependencies and their license (#13591)
ngxson committed 1 year ago
Verified 06c1e4ab
releases : use arm version of curl for arm releases (#13592)
slaren committed 1 year ago
Verified 415e40a3
metal : add FA-vec kernel for head size 64 (#13583)
ggerganov committed 1 year ago
Verified 654a6779
llama : print hint when loading a model when no backends are loaded (#13589)
slaren committed 1 year ago
Verified 5364ae4b
ci : add ppc64el to build-linux-cross (#13575)
CISC committed 1 year ago
Verified 7c07ac24
sycl : fixed compilation warnings (#13582)
lslusarczyk committed 1 year ago
Verified 0a338ed0
Merge remote-tracking branch 'origin/master' into tool-diffs
ochafik committed 1 year ago
6946a835
minja: sync (qwen3) (#13573)
ochafik committed 1 year ago
Verified bc098c3c
Merge remote-tracking branch 'origin/master' into tool-diffs
ochafik committed 1 year ago
d6e1d5bf
gguf : use ggml log system (#13571)
slaren committed 1 year ago
Verified c6a2c9e7
gguf-py : fix disconnect-before-connect in editor-gui (#13569)
danielzgtg committed 1 year ago
Verified 07ad2b6d
convert : fix conversion for llama 4 (#13567)
ngxson committed 1 year ago
Verified c531edfa
sycl: simplify bin_bcast_kernel (#13383)
AD2605 committed 1 year ago
Verified 02cdd2d8
sycl: reordered Q4_K MMVQ (#13109)
sgeor255 committed 1 year ago
Verified 64bb51cf
sycl: use oneDNN for matrices multiplication (#12972)
lslusarczyk committed 1 year ago
Verified 9c404ed5
llama-bench : fix -ot with dl backends (#13563)
slaren committed 1 year ago
Verified 6c8b9150
webui : handle PDF input (as text or image) + convert pasted long content to file (#13562)
ngxson committed 1 year ago
Verified 3cc1f1f1
fix merge
ochafik committed 1 year ago
573e8c3d
Merge remote-tracking branch 'origin/master' into tool-diffs
ochafik committed 1 year ago
ad07a3b0
server : proper error handling for missing elements in messages array (OpenAI compatible backend) (#13540)
pwilkin committed 1 year ago
Verified c753d7be
bench : handle decode errors (#13548)
ggerganov committed 1 year ago
Verified b2838049
Terms Of Use Privacy Policy Refund Policy Impressum