llama.cpp
cpu: support for dynamic reshape/splitting for large single-row ops
#31218
Open

cpu: support for dynamic reshape/splitting for large single-row ops #31218

max-krasnyansky wants to merge 2 commits into master from maxk/cpy-dyn-reshape
max-krasnyansky
max-krasnyansky cpu: split large single-row tensors to improve CPU utilization in una…
ba97234c
max-krasnyansky cpu: adjust splitting thresholds and add a #define for them
2df55ed7
max-krasnyansky max-krasnyansky requested a review from ggerganov ggerganov 2 days ago
github-actions github-actions added ggml
max-krasnyansky
chaxu01
chaxu01 commented on 2026-10-28
chaxu01
chaxu01 commented on 2026-10-28

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone