onnxruntime
86d38813 - Fix LinearAttention on GPUs with limited shared memory (#31982)

Commit
5 days ago
Fix LinearAttention on GPUs with limited shared memory (#31982) ### Description - Detect when the recurrent CUDA kernel exceeds the device’s opt-in shared-memory limit. - Route supported shapes to the column-parallel kernel instead. - Return an actionable error when no compatible fallback exists. ### Motivation and Context The fixed-shape LinearAttention kernel requested 66,560 bytes of shared memory, exceeding the 65,536-byte limit on some GPUs. `cudaFuncSetAttribute` consequently failed with `cudaErrorInvalidValue`. --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: tianleiwu <30328909+tianleiwu@users.noreply.github.com> Co-authored-by: Tianlei Wu <tlwu@microsoft.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Author
Parents
Loading