PR #25228 CUDA: Support CUDA Virtual Devices

CUDA: Support CUDA Virtual Devices #25228

anavp-nvidia wants to merge 2 commits into ggml-org:master from anavp-nvidia:cuda_virtual_devices

anavp-nvidia requested a review 4 days ago

github-actions added ggml

github-actions added CUDA

support cuda virtual devices

93a8f5ba

separate streams per virtual device

f57debfe

anavp-nvidia force pushed from dc6c012b to f57debfe 3 days ago

gaugarg-nv commented on 2026-07-02

Reviewers

gaugarg-nv

Assignees

No one assigned

Labels

ggml CUDA

Milestone

No milestone