transformers.js
Add StaticCache: fixed-capacity in-place KV cache for WebGPU
#1745

Open

Add StaticCache: fixed-capacity in-place KV cache for WebGPU #1745

kylo5aby wants to merge 2 commits into huggingface:main from kylo5aby:feat/static-cache

Support optional pre-allocated output tensors (fetches) in sessionRun

4a7e2c88

kylo5aby marked this pull request as draft 16 days ago

kylo5aby marked this pull request as ready for review 15 days ago

nico-martin requested changes on 2026-08-24

nico-martin assigned

nico-martin 5 days ago

kylo5aby force pushed from 6f671c58 to 3ed80ebc 3 days ago

nico-martin requested changes on 2026-08-26

kylo5aby force pushed from 3ed80ebc to 7727751f 2 days ago

Add StaticCache

fa41153d

kylo5aby force pushed from 7727751f to fa41153d 2 days ago

nico-martin approved these changes on 2026-08-29

Reviewers

nico-martin

Assignees

nico-martin

Labels

None yet

Milestone

No milestone