llama.cpp
model: M3: Move MSA into a new memory implementation
#26338
Merged

model: M3: Move MSA into a new memory implementation #26338

timkhronos
timkhronos timkhronos requested a review from CISC CISC 22 days ago
timkhronos timkhronos requested a review from ggerganov ggerganov 22 days ago
github-actions github-actions added model
ggerganov
ngxson
timkhronos Move MSA logic from llama-kv-cache into llama-kv-cache-msa
f7e27bda
timkhronos timkhronos force pushed from 938640f6 to f7e27bda 22 days ago
timkhronos
timkhronos timkhronos changed the title model: M3: Decouple MSA block selection from kv cell layout model: M3: Decouple MSA block selection from kv cell layout and move MSA into a new llama_kv_cache_msa memory implementation 21 days ago
timkhronos timkhronos changed the title model: M3: Decouple MSA block selection from kv cell layout and move MSA into a new llama_kv_cache_msa memory implementation model: M3: Move MSA into a new llama_kv_cache_msa memory implementation 21 days ago
timkhronos timkhronos changed the title model: M3: Move MSA into a new llama_kv_cache_msa memory implementation model: M3: Move MSA into a new memory implementation 21 days ago
ggerganov ggerganov assigned ggerganov ggerganov 21 days ago
timkhronos Merge branch 'ggml-org:master' into MSA-block-selection-kv-cell
ad246695
ggerganov Merge branch 'master' into MSA-block-selection-kv-cell
5be673d5
ggerganov cont : minor
455db726
ggerganov
ggerganov approved these changes on 2026-08-03
ggerganov ggerganov added merge ready
ggerganov cont : ws fix
2248ec7d
ggerganov ggerganov merged 67d5978b into master 18 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone