llama.cpp
369e1cd6 - ggml: optimize concat op by replacing per-element memcpy with row-level memcpy (#24575)

Commit
4 days ago
ggml: optimize concat op by replacing per-element memcpy with row-level memcpy (#24575) * ggml: optimize concat op by replacing per-element memcpy with row-level memcpy * ggml: fix concat offsets for row-level copies * ggml: add concat row contiguity asserts * ggml: move concat block size asserts * ggml: remove redundant concat asserts * Update ggml/src/ggml-cpu/ops.cpp Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@huggingface.co> --------- Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@huggingface.co>
Author
Parents
Loading