llama.cpp
[CUDA] Enable CUDA Graph on CUDA Toolkit < 12.x
#12394

Merged

[CUDA] Enable CUDA Graph on CUDA Toolkit < 12.x #12394

ggerganov merged 3 commits into ggml-org:master from gaugarg-nv:enable_cuda_graph_on_11.x

Enable CUDA Graph on CTK < 12.x

fc7f195c

github-actions added Nvidia GPU

github-actions added ggml

gaugarg-nv changed the title ~~Enable CUDA Graph on CUDA Toolkit < 12.x~~ [CUDA] Enable CUDA Graph on CUDA Toolkit < 12.x 1 year ago

Fix compilation errors with MUSA

db400a65

ggerganov commented on 2025-03-17

Disable CUDA Graph for MUSA

a05f2b87

ggerganov approved these changes on 2025-03-17

ggerganov merged b1b132ef into master 1 year ago

gaugarg-nv deleted the enable_cuda_graph_on_11.x branch 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

Nvidia GPU ggml

Milestone

No milestone