llama.cpp
cuda: fix crash when querying memory on device with no free memory.
#25157

Open

cuda: fix crash when querying memory on device with no free memory. #25157

cphlipot wants to merge 1 commit into ggml-org:master from cphlipot:nonfatal_cuda_mem_check

cuda: Don't crash when querying memory on device with no free memory.

5956e665

github-actions added ggml

github-actions added CUDA

cphlipot marked this pull request as ready for review 7 days ago

cphlipot requested a review 7 days ago

cphlipot changed the title ~~cuda: Don't crash when querying memory on device with no free memory.~~ cuda: fix crash when querying memory on device with no free memory. 7 days ago

JohannesGaessler approved these changes on 2026-06-30

ORippler approved these changes on 2026-06-30

Reviewers

ORippler

JohannesGaessler

Assignees

No one assigned

Labels

ggml CUDA

Milestone

No milestone

llama.cpp cuda: fix crash when querying memory on device with no free memory. #25157 Open

cuda: fix crash when querying memory on device with no free memory. #25157

llama.cpp
cuda: fix crash when querying memory on device with no free memory.
#25157

Open