transformers

f78dc44f - Cache the latent and the rotary key of latent attention as one row

Cache the latent and the rotary key of latent attention as one row One 576-wide row per token on DeepSeek V3 instead of two: the layout paged MLA kernels read, and one write and one read per layer.