llama.cpp
CUDA: fix MMQ stream-k rounding if ne00 % 128 != 0
#8311

Merged

CUDA: fix MMQ stream-k rounding if ne00 % 128 != 0 #8311

JohannesGaessler merged 1 commit into ggml-org:master from JohannesGaessler:cuda-fix-stream-k-rounding

CUDA: fix MMQ stream-k rounding if ne00 % 128 != 0

54557c3d

JohannesGaessler added Review Complexity : Medium

github-actions added Nvidia GPU

slaren approved these changes on 2024-07-04

JohannesGaessler merged bcefa03b into master 1 year ago

Reviewers

slaren

Assignees

No one assigned

Labels

Nvidia GPU Review Complexity : Medium

Milestone

No milestone