ggerganov/llama.cpp

Pull Requests Commits

bitnet : pad tensors to 256

ggerganov committed 1 year ago

Verified e9f2abfc

finish i2_s/i8_s vec_dot x86 simd

Eddie-Wang1120 committed 1 year ago

569a03ed

Eddie-Wang1120 committed 1 year ago

95dced07

delete redundant

Eddie-Wang1120 committed 1 year ago

7a8961ff

Eddie-Wang1120 committed 1 year ago

5e5eee7b

change table name

Eddie-Wang1120 committed 1 year ago

f395dd9c

Merge branch 'ggerganov:master' into bitnet

Eddie-Wang1120 committed 1 year ago

Verified c0cd08d4

Fix a typo and add Fedora 40 pacakge to install for Vulkan (#7794) [no ci]

metal3d committed 1 year ago

Verified f2b5764b

vulkan: select only one device for single gpu with multiple drivers (#7582)

Adriankhl committed 1 year ago

Verified 73bac2b1

Update Vulkan RoPE implementation (#7818)

0cc4m committed 1 year ago

Verified ef52d1d1

fix broken link in pr template (#7880) [no ci]

deven367 committed 1 year ago

Verified 14f83526

github: move PR template to .github/ root (#7868)

mofosyne committed 1 year ago

Verified 6fe42d07

llama-bench: more compact markdown tables (#7879)

JohannesGaessler committed 1 year ago

Verified 148995e5

tests : check the Python version (#7872)

ggerganov committed 1 year ago

Verified 4bfe50f7

CUDA: int8 tensor cores for MMQ (q4_K, q5_K, q6_K) (#7860)

JohannesGaessler committed 1 year ago

Verified bdcb8f42

fix CUDA CI by using a windows-2019 image (#7861)

slaren committed 1 year ago

Verified c2ce6c47

Merge branch 'ggerganov:master' into bitnet

Eddie-Wang1120 committed 1 year ago

Verified 2322e9db

Eddie-Wang1120 committed 1 year ago

de1d5073

json: refine constraint for whitespace to avoid runaways yet allow pretty print (#7866)

ochafik committed 1 year ago

Verified b61eb964

`json`: document schema conversion in GBNF readme, align manual grammar examples & converters (#7841)

ochafik committed 1 year ago

Verified 396b18df

cmake : fix CMake requirement for CUDA (#7821)

cebtenzzre committed 1 year ago

Verified 864a99e7

ci : try win-2019 on server windows test (#7854)

slaren committed 1 year ago

Verified fd5ea0f8

examples : remove --instruct remnants (#7846)

ggerganov committed 1 year ago

Verified c28a8390

server : improve "prompt" handling (#7847)

ggerganov committed 1 year ago

Verified d9da0e49

CUDA: use tensor cores for MMQ (#7676)

JohannesGaessler committed 1 year ago

Verified 1f0dabda

use the correct SYCL context for host USM allocations (#7777)

bashbaug committed 1 year ago

Verified af4ae502

Eddie-Wang1120 committed 1 year ago

c0fd4df8

Merge branch 'ggerganov:master' into bitnet

Eddie-Wang1120 committed 1 year ago

Verified 841c903f

Eddie-Wang1120 committed 1 year ago

abd798d7

flake.lock: Update (#7838)

ggerganov committed 1 year ago

Verified 10ceba35

Older