ggerganov/llama.cpp

Pull Requests Commits

metal : utilize max shared memory for mul_mat_id

ggerganov committed 349 days ago

Verified eaf34ba0

rpc : fix ggml_backend_rpc_supports_buft() (#7918)

rgerganov committed 350 days ago

Verified 172c8256

readme : Remove outdated instructions from README.md (#7914) [no ci]

Galunid committed 350 days ago

Verified a55eb1bf

move BLAS to a separate backend (#6210)

slaren committed 351 days ago

Verified f578b86b

`build`: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

ochafik committed 351 days ago

Verified 1c641e6a

CUDA: fix broken oob check for FA vec f32 kernel (#7904)

JohannesGaessler committed 351 days ago

Verified 96355290

tests : add non-cont unary tests (#7857)

ggerganov committed 351 days ago

Verified a9cae480

ggml : improve ggml_is_contiguous logic (#7856)

ggerganov committed 351 days ago

Verified bfaa676b

server : restore numeric prompts (#7883)

ggerganov committed 351 days ago

Verified 704a35b1

update intel docker oneapi-basekit to 2024.1.1-devel-ubuntu22.04 (#7894)

airMeng committed 351 days ago

Verified dcf75270

Fix a typo and add Fedora 40 pacakge to install for Vulkan (#7794) [no ci]

metal3d committed 352 days ago

Verified f2b5764b

vulkan: select only one device for single gpu with multiple drivers (#7582)

Adriankhl committed 352 days ago

Verified 73bac2b1

Update Vulkan RoPE implementation (#7818)

0cc4m committed 352 days ago

Verified ef52d1d1

fix broken link in pr template (#7880) [no ci]

deven367 committed 352 days ago

Verified 14f83526

github: move PR template to .github/ root (#7868)

mofosyne committed 352 days ago

Verified 6fe42d07

llama-bench: more compact markdown tables (#7879)

JohannesGaessler committed 352 days ago

Verified 148995e5

tests : check the Python version (#7872)

ggerganov committed 352 days ago

Verified 4bfe50f7

CUDA: int8 tensor cores for MMQ (q4_K, q5_K, q6_K) (#7860)

JohannesGaessler committed 352 days ago

Verified bdcb8f42

fix CUDA CI by using a windows-2019 image (#7861)

slaren committed 352 days ago

Verified c2ce6c47

json: refine constraint for whitespace to avoid runaways yet allow pretty print (#7866)

ochafik committed 353 days ago

Verified b61eb964

`json`: document schema conversion in GBNF readme, align manual grammar examples & converters (#7841)

ochafik committed 353 days ago

Verified 396b18df

cmake : fix CMake requirement for CUDA (#7821)

cebtenzzre committed 353 days ago

Verified 864a99e7

ci : try win-2019 on server windows test (#7854)

slaren committed 353 days ago

Verified fd5ea0f8

examples : remove --instruct remnants (#7846)

ggerganov committed 353 days ago

Verified c28a8390

server : improve "prompt" handling (#7847)

ggerganov committed 353 days ago

Verified d9da0e49

CUDA: use tensor cores for MMQ (#7676)

JohannesGaessler committed 353 days ago

Verified 1f0dabda

use the correct SYCL context for host USM allocations (#7777)

bashbaug committed 353 days ago

Verified af4ae502

flake.lock: Update (#7838)

ggerganov committed 354 days ago

Verified 10ceba35

imatrix : handle partial entries (#7833)

ggerganov committed 354 days ago

Verified e95beeb1

docs: Added initial PR template with directions for doc only changes and squash merges [no ci] (#7700)

nicolasperez19 committed 354 days ago

Verified 57bf62ce

Older