transformers
1aa1ba90 - Merge branch 'cb-linear-attention' into cb-cache-layout

Commit

2 days ago

Merge branch 'cb-linear-attention' into cb-cache-layout

References

#50356 - Size the paged cache from the rows and states the layers declare

#50359 - Run Qwen4-Exp under continuous batching

#50365 - Run multi-head latent attention models under continuous batching

#50369 - Decode multi-head latent attention from the cache pages with FlashMLA

Author

qgallouedec

qgallouedec

Parents

Loading