transformers.js
Add StaticCache: fixed-capacity in-place KV cache for WebGPU
#1745

Open

Add StaticCache: fixed-capacity in-place KV cache for WebGPU #1745

kylo5aby wants to merge 2 commits into huggingface:main from kylo5aby:feat/static-cache

kylo5aby marked this pull request as draft 61 days ago

kylo5aby marked this pull request as ready for review 60 days ago

nico-martin requested changes on 2026-08-24

nico-martin assigned

nico-martin 50 days ago

kylo5aby force pushed from 6f671c58 to 3ed80ebc 48 days ago

nico-martin requested changes on 2026-08-26

kylo5aby force pushed from 3ed80ebc to 7727751f 47 days ago

kylo5aby force pushed from 7727751f to fa41153d 47 days ago

nico-martin approved these changes on 2026-08-29

Support optional pre-allocated output tensors (fetches) in sessionRun

b572feb2

Add StaticCache

4813aa94

kylo5aby force pushed from fa41153d to 4813aa94 22 days ago

Reviewers

nico-martin

Assignees

nico-martin

Labels

None yet

Milestone

No milestone