llama.cpp
cuda: reset cuda context after reading memory size
#23935

Merged

cuda: reset cuda context after reading memory size #23935

0cc4m merged 5 commits into master from 0cc4m/cuda-get-memory-device-reset

0cc4m requested a review 9 days ago

github-actions added Nvidia GPU

github-actions added ggml

JohannesGaessler requested changes on 2026-06-02

cuda: reset device in get_memory function if no backend is active

c1c3b9b4

also count device and host buffers

61e659a4

0cc4m force pushed from a182b357 to 61e659a4 5 days ago

0cc4m requested a review from

IMbackK 5 days ago

exclude hip and musa from counting and device reset

94b62910

0cc4m removed review request from

IMbackK 5 days ago

JohannesGaessler commented on 2026-06-04

use device mutex instead of atomic

f2f5f246

JohannesGaessler approved these changes on 2026-06-05

am17an approved these changes on 2026-06-06

undo backend_free function move

3167ccb8

CISC approved these changes on 2026-06-07

0cc4m merged 0f7fada5 into master 1 day ago

0cc4m deleted the 0cc4m/cuda-get-memory-device-reset branch 1 day ago

Reviewers

CISC

am17an

JohannesGaessler

Assignees

No one assigned

Labels

Nvidia GPU ggml

Milestone

No milestone