llama.cpp
cuda: fix vmm oom issue on NVIDIA AGX Orin
#4687
Merged

cuda: fix vmm oom issue on NVIDIA AGX Orin #4687

hydai
hydai cuda: fix vmm oom issue on NVIDIA AGX Orin
b289c24f
slaren
slaren approved these changes on 2023-12-29
slaren slaren merged 91bb39ce into master 2 years ago
hydai hydai deleted the fix_cuda_vmm_oom_on_agx_orin branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone