ngxson/llama.cpp

Pull Requests Commits

add warn about degraded quality

ngxson committed 1 year ago

d5e50aa0

ngxson committed 1 year ago

186d7a88

test: add notion of huge models

ngxson committed 1 year ago

e52481ba

fix llava-1.6 test

ngxson committed 1 year ago

b199e70d

add test & docs

ngxson committed 1 year ago

f083c192

ngxson committed 1 year ago

53fb6223

ngxson committed 1 year ago

8646240a

ngxson committed 1 year ago

791f1069

rm load_image_size

ngxson committed 1 year ago

3645fe0b

handle llama 4 preprocessing

ngxson committed 1 year ago

4217d424

add image_grid_pinpoints

ngxson committed 1 year ago

b74122f0

ngxson committed 1 year ago

5b81972e

logits matched, but it still preceives the image incorrectly

ngxson committed 1 year ago

919318e3

add debug_graph

ngxson committed 1 year ago

7d9d4e34

ngxson committed 1 year ago

2ffafd5d

fix merge conflicts

ngxson committed 1 year ago

8caeed5c

Merge branch 'master' into xsn/mtmd_llama4_new

ngxson committed 1 year ago

844a3449

server : added --no-prefill-assistant flag (#13608)

isaac-mcfadyen committed 1 year ago

Verified 6a2bc8bf

cmake: use the current build config for vulkan-shaders-gen (#13595)

giladgd committed 1 year ago

Verified e3a7cf6c

parallel : add option for non-shared and larger prompts (#13598)

ggerganov committed 1 year ago

Verified 518329b2

vulkan: move common FA code to flash_attn_base.comp (#13556)

jeffbolznv committed 1 year ago

Verified 2f5a4e1e

vulkan: use scalar FA rather than coopmat2 when N==1 (#13554)

jeffbolznv committed 1 year ago

Verified 4f41ee11

llguidance : official v0.7.20 release (no actual changes) [noci] (#13594)

CoffeeVampir3 committed 1 year ago

Verified 3e0be1ca

server : do not return error out of context (with ctx shift disabled) (#13577)

ngxson committed 1 year ago

Verified 6aa892ec

webui : improve accessibility for visually impaired people (#13551)

ngxson committed 1 year ago

Verified aea9f8b4

readme : add list of dependencies and their license (#13591)

ngxson committed 1 year ago

Verified 06c1e4ab

releases : use arm version of curl for arm releases (#13592)

slaren committed 1 year ago

Verified 415e40a3

metal : add FA-vec kernel for head size 64 (#13583)

ggerganov committed 1 year ago

Verified 654a6779

llama : print hint when loading a model when no backends are loaded (#13589)

slaren committed 1 year ago

Verified 5364ae4b

ci : add ppc64el to build-linux-cross (#13575)

CISC committed 1 year ago

Verified 7c07ac24

Older